2023-10-30 14:52:42,973 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-10-30 14:52:43,189 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4 2023-10-30 14:52:43,200 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-30 14:52:43,201 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/cluster_978bf1f8-7fe4-59b0-fbf7-a402efa6c985, deleteOnExit=true 2023-10-30 14:52:43,201 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-30 14:52:43,202 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/test.cache.data in system properties and HBase conf 2023-10-30 14:52:43,202 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/hadoop.tmp.dir in system properties and HBase conf 2023-10-30 14:52:43,202 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/hadoop.log.dir in system properties and HBase conf 2023-10-30 14:52:43,203 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-30 14:52:43,203 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-30 14:52:43,204 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-30 14:52:43,308 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-30 14:52:43,663 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-30 14:52:43,668 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-30 14:52:43,668 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-30 14:52:43,669 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-30 14:52:43,669 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-30 14:52:43,669 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-30 14:52:43,670 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-30 14:52:43,670 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-30 14:52:43,671 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-30 14:52:43,671 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-30 14:52:43,672 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/nfs.dump.dir in system properties and HBase conf 2023-10-30 14:52:43,672 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/java.io.tmpdir in system properties and HBase conf 2023-10-30 14:52:43,672 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-30 14:52:43,673 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-30 14:52:43,673 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-30 14:52:44,269 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-30 14:52:44,273 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-30 14:52:44,548 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-30 14:52:44,734 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-30 14:52:44,748 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-30 14:52:44,780 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-30 14:52:44,807 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/java.io.tmpdir/Jetty_localhost_34155_hdfs____4kv41m/webapp 2023-10-30 14:52:44,947 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34155 2023-10-30 14:52:44,956 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-30 14:52:44,956 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-30 14:52:45,445 WARN [Listener at localhost/38259] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-30 14:52:45,529 WARN [Listener at localhost/38259] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-30 14:52:45,552 WARN [Listener at localhost/38259] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-30 14:52:45,561 INFO [Listener at localhost/38259] log.Slf4jLog(67): jetty-6.1.26 2023-10-30 14:52:45,568 INFO [Listener at localhost/38259] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/java.io.tmpdir/Jetty_localhost_36245_datanode____3ad6fr/webapp 2023-10-30 14:52:45,673 INFO [Listener at localhost/38259] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36245 2023-10-30 14:52:45,975 WARN [Listener at localhost/34621] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-30 14:52:46,425 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xab6710e06f4e877a: Processing first storage report for DS-17feb69e-7cd3-4fdb-b6ff-2146977b0366 from datanode 6d91fac6-672b-4e44-9534-6547ad81bdfc 2023-10-30 14:52:46,427 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xab6710e06f4e877a: from storage DS-17feb69e-7cd3-4fdb-b6ff-2146977b0366 node DatanodeRegistration(127.0.0.1:46381, datanodeUuid=6d91fac6-672b-4e44-9534-6547ad81bdfc, infoPort=40237, infoSecurePort=0, ipcPort=34621, storageInfo=lv=-57;cid=testClusterID;nsid=1082157831;c=1698677564337), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-30 14:52:46,427 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xab6710e06f4e877a: Processing first storage report for DS-1de94d65-e12a-42f2-a633-466ea61f414d from datanode 6d91fac6-672b-4e44-9534-6547ad81bdfc 2023-10-30 14:52:46,427 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xab6710e06f4e877a: from storage DS-1de94d65-e12a-42f2-a633-466ea61f414d node DatanodeRegistration(127.0.0.1:46381, datanodeUuid=6d91fac6-672b-4e44-9534-6547ad81bdfc, infoPort=40237, infoSecurePort=0, ipcPort=34621, storageInfo=lv=-57;cid=testClusterID;nsid=1082157831;c=1698677564337), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-30 14:52:46,438 DEBUG [Listener at localhost/34621] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4 2023-10-30 14:52:46,514 INFO [Listener at localhost/34621] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/cluster_978bf1f8-7fe4-59b0-fbf7-a402efa6c985/zookeeper_0, clientPort=49804, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/cluster_978bf1f8-7fe4-59b0-fbf7-a402efa6c985/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/cluster_978bf1f8-7fe4-59b0-fbf7-a402efa6c985/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-30 14:52:46,527 INFO [Listener at localhost/34621] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49804 2023-10-30 14:52:46,533 INFO [Listener at localhost/34621] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 14:52:46,535 INFO [Listener at localhost/34621] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 14:52:47,212 INFO [Listener at localhost/34621] util.FSUtils(471): Created version file at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d with version=8 2023-10-30 14:52:47,213 INFO [Listener at localhost/34621] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/hbase-staging 2023-10-30 14:52:47,483 INFO [Listener at localhost/34621] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-30 14:52:47,864 INFO [Listener at localhost/34621] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=3 2023-10-30 14:52:47,895 INFO [Listener at localhost/34621] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-30 14:52:47,895 INFO [Listener at localhost/34621] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-30 14:52:47,895 INFO [Listener at localhost/34621] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-30 14:52:47,895 INFO [Listener at localhost/34621] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-30 14:52:47,896 INFO [Listener at localhost/34621] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-30 14:52:48,011 INFO [Listener at localhost/34621] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-30 14:52:48,069 DEBUG [Listener at localhost/34621] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-30 14:52:48,142 INFO [Listener at localhost/34621] ipc.NettyRpcServer(120): Bind to /148.251.75.209:43911 2023-10-30 14:52:48,150 INFO [Listener at localhost/34621] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 14:52:48,152 INFO [Listener at localhost/34621] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 14:52:48,171 INFO [Listener at localhost/34621] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43911 connecting to ZooKeeper ensemble=127.0.0.1:49804 2023-10-30 14:52:48,204 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:439110x0, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-30 14:52:48,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:43911-0x10183557d440000 connected 2023-10-30 14:52:48,231 DEBUG [Listener at localhost/34621] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-30 14:52:48,233 DEBUG [Listener at localhost/34621] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-30 14:52:48,237 DEBUG [Listener at localhost/34621] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-30 14:52:48,246 DEBUG [Listener at localhost/34621] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43911 2023-10-30 14:52:48,247 DEBUG [Listener at localhost/34621] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43911 2023-10-30 14:52:48,247 DEBUG [Listener at localhost/34621] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43911 2023-10-30 14:52:48,248 DEBUG [Listener at localhost/34621] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43911 2023-10-30 14:52:48,248 DEBUG [Listener at localhost/34621] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43911 2023-10-30 14:52:48,254 INFO [Listener at localhost/34621] master.HMaster(444): hbase.rootdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d, hbase.cluster.distributed=false 2023-10-30 14:52:48,318 INFO [Listener at localhost/34621] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=3 2023-10-30 14:52:48,318 INFO [Listener at localhost/34621] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-30 14:52:48,319 INFO [Listener at localhost/34621] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-30 14:52:48,319 INFO [Listener at localhost/34621] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-30 14:52:48,319 INFO [Listener at localhost/34621] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-30 14:52:48,319 INFO [Listener at localhost/34621] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-30 14:52:48,324 INFO [Listener at localhost/34621] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-30 14:52:48,327 INFO [Listener at localhost/34621] ipc.NettyRpcServer(120): Bind to /148.251.75.209:36359 2023-10-30 14:52:48,329 INFO [Listener at localhost/34621] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-30 14:52:48,335 DEBUG [Listener at localhost/34621] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-10-30 14:52:48,336 INFO [Listener at localhost/34621] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 14:52:48,339 INFO [Listener at localhost/34621] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 14:52:48,341 INFO [Listener at localhost/34621] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36359 connecting to ZooKeeper ensemble=127.0.0.1:49804 2023-10-30 14:52:48,345 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:363590x0, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-30 14:52:48,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36359-0x10183557d440001 connected 2023-10-30 14:52:48,345 DEBUG [Listener at localhost/34621] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-30 14:52:48,347 DEBUG [Listener at localhost/34621] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-30 14:52:48,348 DEBUG [Listener at localhost/34621] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-30 14:52:48,348 DEBUG [Listener at localhost/34621] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36359 2023-10-30 14:52:48,349 DEBUG [Listener at localhost/34621] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36359 2023-10-30 14:52:48,350 DEBUG [Listener at localhost/34621] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36359 2023-10-30 14:52:48,355 DEBUG [Listener at localhost/34621] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36359 2023-10-30 14:52:48,355 DEBUG [Listener at localhost/34621] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36359 2023-10-30 14:52:48,357 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,43911,1698677567334 2023-10-30 14:52:48,364 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-30 14:52:48,366 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,43911,1698677567334 2023-10-30 14:52:48,382 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-30 14:52:48,382 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-30 14:52:48,382 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 14:52:48,383 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-30 14:52:48,384 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,43911,1698677567334 from backup master directory 2023-10-30 14:52:48,384 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-30 14:52:48,386 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,43911,1698677567334 2023-10-30 14:52:48,386 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-30 14:52:48,387 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-30 14:52:48,387 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,43911,1698677567334 2023-10-30 14:52:48,390 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-30 14:52:48,391 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-30 14:52:48,466 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/hbase.id with ID: 708f7276-0895-4323-9788-e277e32961e3 2023-10-30 14:52:48,510 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 14:52:48,529 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 14:52:48,972 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6eddd9e8 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:52:49,002 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b7f672f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:52:49,022 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-30 14:52:49,023 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-30 14:52:49,038 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-30 14:52:49,038 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-30 14:52:49,040 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-30 14:52:49,043 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-30 14:52:49,044 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-30 14:52:49,073 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/MasterData/data/master/store-tmp 2023-10-30 14:52:49,100 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:52:49,100 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-30 14:52:49,101 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 14:52:49,101 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 14:52:49,101 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-30 14:52:49,101 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 14:52:49,101 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 14:52:49,101 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-30 14:52:49,103 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/MasterData/WALs/jenkins-hbase20.apache.org,43911,1698677567334 2023-10-30 14:52:49,129 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43911%2C1698677567334, suffix=, logDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/MasterData/WALs/jenkins-hbase20.apache.org,43911,1698677567334, archiveDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/MasterData/oldWALs, maxLogs=10 2023-10-30 14:52:49,191 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46381,DS-17feb69e-7cd3-4fdb-b6ff-2146977b0366,DISK] 2023-10-30 14:52:49,197 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-30 14:52:49,253 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/MasterData/WALs/jenkins-hbase20.apache.org,43911,1698677567334/jenkins-hbase20.apache.org%2C43911%2C1698677567334.1698677569139 2023-10-30 14:52:49,254 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46381,DS-17feb69e-7cd3-4fdb-b6ff-2146977b0366,DISK]] 2023-10-30 14:52:49,254 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-30 14:52:49,254 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:52:49,257 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-30 14:52:49,258 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-30 14:52:49,317 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-30 14:52:49,325 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-30 14:52:49,354 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-30 14:52:49,366 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:52:49,373 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-30 14:52:49,375 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-30 14:52:49,392 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-30 14:52:49,396 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:52:49,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63653677, jitterRate=-0.0514862984418869}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 14:52:49,397 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-30 14:52:49,399 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-30 14:52:49,416 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-30 14:52:49,416 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-30 14:52:49,418 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-30 14:52:49,420 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-30 14:52:49,452 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 31 msec 2023-10-30 14:52:49,452 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-30 14:52:49,480 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-30 14:52:49,486 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-30 14:52:49,512 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-30 14:52:49,516 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-30 14:52:49,518 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-30 14:52:49,524 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-30 14:52:49,530 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-30 14:52:49,533 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 14:52:49,534 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-30 14:52:49,535 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-30 14:52:49,546 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-30 14:52:49,550 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-30 14:52:49,550 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-30 14:52:49,550 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 14:52:49,551 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,43911,1698677567334, sessionid=0x10183557d440000, setting cluster-up flag (Was=false) 2023-10-30 14:52:49,568 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 14:52:49,572 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-30 14:52:49,574 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,43911,1698677567334 2023-10-30 14:52:49,584 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 14:52:49,587 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-30 14:52:49,589 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,43911,1698677567334 2023-10-30 14:52:49,591 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.hbase-snapshot/.tmp 2023-10-30 14:52:49,659 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(951): ClusterId : 708f7276-0895-4323-9788-e277e32961e3 2023-10-30 14:52:49,664 DEBUG [RS:0;jenkins-hbase20:36359] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-30 14:52:49,676 DEBUG [RS:0;jenkins-hbase20:36359] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-30 14:52:49,676 DEBUG [RS:0;jenkins-hbase20:36359] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-30 14:52:49,684 DEBUG [RS:0;jenkins-hbase20:36359] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-30 14:52:49,687 DEBUG [RS:0;jenkins-hbase20:36359] zookeeper.ReadOnlyZKClient(139): Connect 0x3ce9878e to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:52:49,698 DEBUG [RS:0;jenkins-hbase20:36359] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@322e6e63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:52:49,699 DEBUG [RS:0;jenkins-hbase20:36359] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3611ecfe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-30 14:52:49,728 DEBUG [RS:0;jenkins-hbase20:36359] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:36359 2023-10-30 14:52:49,732 INFO [RS:0;jenkins-hbase20:36359] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-30 14:52:49,732 INFO [RS:0;jenkins-hbase20:36359] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-30 14:52:49,732 DEBUG [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1022): About to register with Master. 2023-10-30 14:52:49,736 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,43911,1698677567334 with isa=jenkins-hbase20.apache.org/148.251.75.209:36359, startcode=1698677568317 2023-10-30 14:52:49,736 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-30 14:52:49,748 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-30 14:52:49,748 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-30 14:52:49,748 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-30 14:52:49,748 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-30 14:52:49,749 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-10-30 14:52:49,749 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 14:52:49,749 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-30 14:52:49,749 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 14:52:49,755 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1698677599755 2023-10-30 14:52:49,757 DEBUG [RS:0;jenkins-hbase20:36359] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-30 14:52:49,758 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-30 14:52:49,761 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-30 14:52:49,761 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-30 14:52:49,767 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-30 14:52:49,770 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-30 14:52:49,783 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-30 14:52:49,784 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-30 14:52:49,784 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-30 14:52:49,785 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-30 14:52:49,788 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-30 14:52:49,791 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-30 14:52:49,793 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-30 14:52:49,793 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-30 14:52:49,800 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-30 14:52:49,801 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-30 14:52:49,805 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1698677569805,5,FailOnTimeoutGroup] 2023-10-30 14:52:49,805 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1698677569805,5,FailOnTimeoutGroup] 2023-10-30 14:52:49,805 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-30 14:52:49,805 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-30 14:52:49,807 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-30 14:52:49,808 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-30 14:52:49,825 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41887, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-30 14:52:49,838 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43911] master.ServerManager(388): Registering regionserver=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:49,855 DEBUG [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d 2023-10-30 14:52:49,855 DEBUG [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38259 2023-10-30 14:52:49,855 DEBUG [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-30 14:52:49,860 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-30 14:52:49,860 DEBUG [RS:0;jenkins-hbase20:36359] zookeeper.ZKUtil(162): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:49,861 WARN [RS:0;jenkins-hbase20:36359] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-30 14:52:49,861 INFO [RS:0;jenkins-hbase20:36359] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-30 14:52:49,862 DEBUG [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/WALs/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:49,863 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,36359,1698677568317] 2023-10-30 14:52:49,873 DEBUG [RS:0;jenkins-hbase20:36359] zookeeper.ZKUtil(162): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:49,883 DEBUG [RS:0;jenkins-hbase20:36359] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-30 14:52:49,891 INFO [RS:0;jenkins-hbase20:36359] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-30 14:52:49,908 INFO [RS:0;jenkins-hbase20:36359] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-30 14:52:49,912 INFO [RS:0;jenkins-hbase20:36359] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:52:49,912 INFO [RS:0;jenkins-hbase20:36359] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:52:49,913 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-30 14:52:49,920 INFO [RS:0;jenkins-hbase20:36359] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-10-30 14:52:49,920 DEBUG [RS:0;jenkins-hbase20:36359] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 14:52:49,920 DEBUG [RS:0;jenkins-hbase20:36359] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 14:52:49,921 DEBUG [RS:0;jenkins-hbase20:36359] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 14:52:49,921 DEBUG [RS:0;jenkins-hbase20:36359] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 14:52:49,921 DEBUG [RS:0;jenkins-hbase20:36359] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 14:52:49,921 DEBUG [RS:0;jenkins-hbase20:36359] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-30 14:52:49,921 DEBUG [RS:0;jenkins-hbase20:36359] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 14:52:49,921 DEBUG [RS:0;jenkins-hbase20:36359] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 14:52:49,922 DEBUG [RS:0;jenkins-hbase20:36359] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 14:52:49,922 DEBUG [RS:0;jenkins-hbase20:36359] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 14:52:49,923 INFO [RS:0;jenkins-hbase20:36359] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-30 14:52:49,924 INFO [RS:0;jenkins-hbase20:36359] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-30 14:52:49,924 INFO [RS:0;jenkins-hbase20:36359] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-30 14:52:49,939 INFO [RS:0;jenkins-hbase20:36359] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-30 14:52:49,942 INFO [RS:0;jenkins-hbase20:36359] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36359,1698677568317-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:52:49,959 INFO [RS:0;jenkins-hbase20:36359] regionserver.Replication(203): jenkins-hbase20.apache.org,36359,1698677568317 started 2023-10-30 14:52:49,959 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,36359,1698677568317, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:36359, sessionid=0x10183557d440001 2023-10-30 14:52:49,959 DEBUG [RS:0;jenkins-hbase20:36359] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-30 14:52:49,959 DEBUG [RS:0;jenkins-hbase20:36359] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:49,959 DEBUG [RS:0;jenkins-hbase20:36359] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,36359,1698677568317' 2023-10-30 14:52:49,959 DEBUG [RS:0;jenkins-hbase20:36359] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:52:49,960 DEBUG [RS:0;jenkins-hbase20:36359] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:52:49,961 DEBUG [RS:0;jenkins-hbase20:36359] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-30 14:52:49,961 DEBUG [RS:0;jenkins-hbase20:36359] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-30 14:52:49,961 DEBUG [RS:0;jenkins-hbase20:36359] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:49,961 DEBUG [RS:0;jenkins-hbase20:36359] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,36359,1698677568317' 2023-10-30 14:52:49,961 DEBUG [RS:0;jenkins-hbase20:36359] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-30 14:52:49,961 DEBUG [RS:0;jenkins-hbase20:36359] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-30 14:52:49,962 DEBUG [RS:0;jenkins-hbase20:36359] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-30 14:52:49,962 INFO [RS:0;jenkins-hbase20:36359] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-30 14:52:49,962 INFO [RS:0;jenkins-hbase20:36359] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-30 14:52:50,072 INFO [RS:0;jenkins-hbase20:36359] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36359%2C1698677568317, suffix=, logDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/WALs/jenkins-hbase20.apache.org,36359,1698677568317, archiveDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/oldWALs, maxLogs=32 2023-10-30 14:52:50,091 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46381,DS-17feb69e-7cd3-4fdb-b6ff-2146977b0366,DISK] 2023-10-30 14:52:50,095 INFO [RS:0;jenkins-hbase20:36359] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/WALs/jenkins-hbase20.apache.org,36359,1698677568317/jenkins-hbase20.apache.org%2C36359%2C1698677568317.1698677570075 2023-10-30 14:52:50,095 DEBUG [RS:0;jenkins-hbase20:36359] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46381,DS-17feb69e-7cd3-4fdb-b6ff-2146977b0366,DISK]] 2023-10-30 14:52:50,210 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-30 14:52:50,212 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-30 14:52:50,212 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d 2023-10-30 14:52:50,231 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:52:50,233 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-30 14:52:50,236 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/info 2023-10-30 14:52:50,237 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-30 14:52:50,238 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:52:50,239 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-30 14:52:50,241 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/rep_barrier 2023-10-30 14:52:50,242 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-30 14:52:50,243 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:52:50,243 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-30 14:52:50,245 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/table 2023-10-30 14:52:50,246 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-30 14:52:50,247 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:52:50,249 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740 2023-10-30 14:52:50,250 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740 2023-10-30 14:52:50,254 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-30 14:52:50,256 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-30 14:52:50,260 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:52:50,261 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72442722, jitterRate=0.07948067784309387}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-30 14:52:50,261 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-30 14:52:50,261 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-30 14:52:50,261 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-30 14:52:50,261 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-30 14:52:50,261 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-30 14:52:50,261 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-30 14:52:50,262 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-30 14:52:50,262 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-30 14:52:50,268 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-30 14:52:50,268 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-30 14:52:50,275 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-30 14:52:50,286 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-30 14:52:50,288 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-30 14:52:50,440 DEBUG [jenkins-hbase20:43911] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-10-30 14:52:50,443 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,36359,1698677568317, state=OPENING 2023-10-30 14:52:50,449 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-30 14:52:50,450 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 14:52:50,451 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-30 14:52:50,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:52:50,638 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:50,642 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-30 14:52:50,645 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-30 14:52:50,658 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-30 14:52:50,658 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-30 14:52:50,663 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36359%2C1698677568317.meta, suffix=.meta, logDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/WALs/jenkins-hbase20.apache.org,36359,1698677568317, archiveDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/oldWALs, maxLogs=32 2023-10-30 14:52:50,680 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46381,DS-17feb69e-7cd3-4fdb-b6ff-2146977b0366,DISK] 2023-10-30 14:52:50,686 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/WALs/jenkins-hbase20.apache.org,36359,1698677568317/jenkins-hbase20.apache.org%2C36359%2C1698677568317.meta.1698677570664.meta 2023-10-30 14:52:50,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46381,DS-17feb69e-7cd3-4fdb-b6ff-2146977b0366,DISK]] 2023-10-30 14:52:50,691 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-30 14:52:50,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-30 14:52:50,709 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-30 14:52:50,714 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-30 14:52:50,719 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-30 14:52:50,720 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:52:50,720 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-30 14:52:50,720 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-30 14:52:50,724 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-30 14:52:50,726 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/info 2023-10-30 14:52:50,727 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/info 2023-10-30 14:52:50,727 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-30 14:52:50,729 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:52:50,729 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-30 14:52:50,731 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/rep_barrier 2023-10-30 14:52:50,731 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/rep_barrier 2023-10-30 14:52:50,732 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-30 14:52:50,733 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:52:50,733 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-30 14:52:50,734 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/table 2023-10-30 14:52:50,735 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/table 2023-10-30 14:52:50,735 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-30 14:52:50,736 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:52:50,739 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740 2023-10-30 14:52:50,742 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740 2023-10-30 14:52:50,745 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-30 14:52:50,749 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-30 14:52:50,751 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65796142, jitterRate=-0.019561082124710083}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-30 14:52:50,751 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-30 14:52:50,760 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1698677570631 2023-10-30 14:52:50,777 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-30 14:52:50,778 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-30 14:52:50,779 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,36359,1698677568317, state=OPEN 2023-10-30 14:52:50,781 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-30 14:52:50,781 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-30 14:52:50,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-30 14:52:50,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36359,1698677568317 in 327 msec 2023-10-30 14:52:50,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-30 14:52:50,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 514 msec 2023-10-30 14:52:50,802 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1480 sec 2023-10-30 14:52:50,802 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1698677570802, completionTime=-1 2023-10-30 14:52:50,803 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-10-30 14:52:50,803 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-10-30 14:52:50,871 DEBUG [hconnection-0x6788978c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:52:50,877 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:52:50,904 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-10-30 14:52:50,904 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1698677630904 2023-10-30 14:52:50,904 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1698677690904 2023-10-30 14:52:50,905 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 101 msec 2023-10-30 14:52:50,930 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43911,1698677567334-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:52:50,930 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43911,1698677567334-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-30 14:52:50,930 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43911,1698677567334-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-30 14:52:50,932 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:43911, period=300000, unit=MILLISECONDS is enabled. 2023-10-30 14:52:50,932 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-30 14:52:50,938 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-30 14:52:50,948 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-30 14:52:50,949 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-30 14:52:50,962 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-30 14:52:50,965 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 14:52:50,968 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 14:52:50,998 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/hbase/namespace/5a58af8ecbd95665bdfc67556085c433 2023-10-30 14:52:51,000 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/hbase/namespace/5a58af8ecbd95665bdfc67556085c433 empty. 2023-10-30 14:52:51,001 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/hbase/namespace/5a58af8ecbd95665bdfc67556085c433 2023-10-30 14:52:51,001 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-30 14:52:51,432 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-30 14:52:51,434 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5a58af8ecbd95665bdfc67556085c433, NAME => 'hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:52:51,448 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:52:51,448 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 5a58af8ecbd95665bdfc67556085c433, disabling compactions & flushes 2023-10-30 14:52:51,448 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433. 2023-10-30 14:52:51,448 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433. 2023-10-30 14:52:51,448 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433. after waiting 0 ms 2023-10-30 14:52:51,449 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433. 2023-10-30 14:52:51,449 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433. 2023-10-30 14:52:51,449 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 5a58af8ecbd95665bdfc67556085c433: 2023-10-30 14:52:51,454 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 14:52:51,470 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698677571457"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677571457"}]},"ts":"1698677571457"} 2023-10-30 14:52:51,499 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 14:52:51,502 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 14:52:51,507 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677571503"}]},"ts":"1698677571503"} 2023-10-30 14:52:51,511 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-30 14:52:51,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5a58af8ecbd95665bdfc67556085c433, ASSIGN}] 2023-10-30 14:52:51,521 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5a58af8ecbd95665bdfc67556085c433, ASSIGN 2023-10-30 14:52:51,523 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5a58af8ecbd95665bdfc67556085c433, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:52:51,674 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5a58af8ecbd95665bdfc67556085c433, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:51,675 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698677571674"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677571674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677571674"}]},"ts":"1698677571674"} 2023-10-30 14:52:51,680 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5a58af8ecbd95665bdfc67556085c433, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:52:51,834 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:51,840 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433. 2023-10-30 14:52:51,841 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5a58af8ecbd95665bdfc67556085c433, NAME => 'hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433.', STARTKEY => '', ENDKEY => ''} 2023-10-30 14:52:51,842 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5a58af8ecbd95665bdfc67556085c433 2023-10-30 14:52:51,843 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:52:51,843 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5a58af8ecbd95665bdfc67556085c433 2023-10-30 14:52:51,843 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5a58af8ecbd95665bdfc67556085c433 2023-10-30 14:52:51,845 INFO [StoreOpener-5a58af8ecbd95665bdfc67556085c433-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5a58af8ecbd95665bdfc67556085c433 2023-10-30 14:52:51,848 DEBUG [StoreOpener-5a58af8ecbd95665bdfc67556085c433-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/namespace/5a58af8ecbd95665bdfc67556085c433/info 2023-10-30 14:52:51,848 DEBUG [StoreOpener-5a58af8ecbd95665bdfc67556085c433-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/namespace/5a58af8ecbd95665bdfc67556085c433/info 2023-10-30 14:52:51,848 INFO [StoreOpener-5a58af8ecbd95665bdfc67556085c433-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a58af8ecbd95665bdfc67556085c433 columnFamilyName info 2023-10-30 14:52:51,849 INFO [StoreOpener-5a58af8ecbd95665bdfc67556085c433-1] regionserver.HStore(310): Store=5a58af8ecbd95665bdfc67556085c433/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:52:51,852 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/namespace/5a58af8ecbd95665bdfc67556085c433 2023-10-30 14:52:51,853 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/namespace/5a58af8ecbd95665bdfc67556085c433 2023-10-30 14:52:51,858 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5a58af8ecbd95665bdfc67556085c433 2023-10-30 14:52:51,863 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/namespace/5a58af8ecbd95665bdfc67556085c433/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:52:51,864 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5a58af8ecbd95665bdfc67556085c433; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62159606, jitterRate=-0.07374969124794006}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 14:52:51,864 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5a58af8ecbd95665bdfc67556085c433: 2023-10-30 14:52:51,866 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433., pid=6, masterSystemTime=1698677571834 2023-10-30 14:52:51,871 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433. 2023-10-30 14:52:51,871 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433. 2023-10-30 14:52:51,873 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5a58af8ecbd95665bdfc67556085c433, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:51,874 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698677571872"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677571872"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677571872"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677571872"}]},"ts":"1698677571872"} 2023-10-30 14:52:51,886 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-30 14:52:51,886 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5a58af8ecbd95665bdfc67556085c433, server=jenkins-hbase20.apache.org,36359,1698677568317 in 202 msec 2023-10-30 14:52:51,891 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-30 14:52:51,891 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5a58af8ecbd95665bdfc67556085c433, ASSIGN in 368 msec 2023-10-30 14:52:51,893 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 14:52:51,893 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677571893"}]},"ts":"1698677571893"} 2023-10-30 14:52:51,897 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-30 14:52:51,901 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 14:52:51,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 951 msec 2023-10-30 14:52:51,965 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-30 14:52:51,966 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-30 14:52:51,966 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 14:52:52,011 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-30 14:52:52,028 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-30 14:52:52,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 31 msec 2023-10-30 14:52:52,045 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-30 14:52:52,060 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-30 14:52:52,065 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-10-30 14:52:52,082 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-30 14:52:52,084 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-30 14:52:52,085 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.697sec 2023-10-30 14:52:52,087 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-30 14:52:52,090 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-30 14:52:52,090 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-30 14:52:52,091 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43911,1698677567334-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-30 14:52:52,092 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43911,1698677567334-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-30 14:52:52,103 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-30 14:52:52,172 DEBUG [Listener at localhost/34621] zookeeper.ReadOnlyZKClient(139): Connect 0x22e51859 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:52:52,176 DEBUG [Listener at localhost/34621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a5e4370, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:52:52,192 DEBUG [hconnection-0x7f296166-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:52:52,203 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:52:52,211 INFO [Listener at localhost/34621] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,43911,1698677567334 2023-10-30 14:52:52,213 DEBUG [Listener at localhost/34621] zookeeper.ReadOnlyZKClient(139): Connect 0x00418667 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:52:52,218 DEBUG [Listener at localhost/34621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@629d523e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:52:52,218 INFO [Listener at localhost/34621] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 14:52:52,238 INFO [Listener at localhost/34621] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=210, OpenFileDescriptor=478, MaxFileDescriptor=60000, SystemLoadAverage=304, ProcessCount=169, AvailableMemoryMB=2519 2023-10-30 14:52:52,253 DEBUG [Listener at localhost/34621] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 14:52:52,256 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 14:52:52,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 14:52:52,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:52,272 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 14:52:52,274 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 14:52:52,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-10-30 14:52:52,277 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c 2023-10-30 14:52:52,278 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c empty. 2023-10-30 14:52:52,280 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c 2023-10-30 14:52:52,280 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-10-30 14:52:52,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-30 14:52:52,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-30 14:52:52,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-30 14:52:52,700 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-10-30 14:52:52,703 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 067dfd97cc9f142313f90d932310385c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:52:52,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-30 14:52:53,131 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:52:53,132 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 067dfd97cc9f142313f90d932310385c, disabling compactions & flushes 2023-10-30 14:52:53,132 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:53,132 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:53,132 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. after waiting 0 ms 2023-10-30 14:52:53,132 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:53,132 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:53,133 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:52:53,138 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 14:52:53,140 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698677573140"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677573140"}]},"ts":"1698677573140"} 2023-10-30 14:52:53,143 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 14:52:53,145 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 14:52:53,145 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677573145"}]},"ts":"1698677573145"} 2023-10-30 14:52:53,148 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-10-30 14:52:53,152 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=067dfd97cc9f142313f90d932310385c, ASSIGN}] 2023-10-30 14:52:53,154 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=067dfd97cc9f142313f90d932310385c, ASSIGN 2023-10-30 14:52:53,156 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=067dfd97cc9f142313f90d932310385c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:52:53,307 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=067dfd97cc9f142313f90d932310385c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:53,308 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698677573307"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677573307"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677573307"}]},"ts":"1698677573307"} 2023-10-30 14:52:53,311 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 067dfd97cc9f142313f90d932310385c, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:52:53,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-30 14:52:53,464 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:53,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:53,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 067dfd97cc9f142313f90d932310385c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c.', STARTKEY => '', ENDKEY => ''} 2023-10-30 14:52:53,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 067dfd97cc9f142313f90d932310385c 2023-10-30 14:52:53,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:52:53,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 067dfd97cc9f142313f90d932310385c 2023-10-30 14:52:53,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 067dfd97cc9f142313f90d932310385c 2023-10-30 14:52:53,476 INFO [StoreOpener-067dfd97cc9f142313f90d932310385c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 067dfd97cc9f142313f90d932310385c 2023-10-30 14:52:53,479 DEBUG [StoreOpener-067dfd97cc9f142313f90d932310385c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1 2023-10-30 14:52:53,479 DEBUG [StoreOpener-067dfd97cc9f142313f90d932310385c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1 2023-10-30 14:52:53,482 INFO [StoreOpener-067dfd97cc9f142313f90d932310385c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 067dfd97cc9f142313f90d932310385c columnFamilyName family1 2023-10-30 14:52:53,486 INFO [StoreOpener-067dfd97cc9f142313f90d932310385c-1] regionserver.HStore(310): Store=067dfd97cc9f142313f90d932310385c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:52:53,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c 2023-10-30 14:52:53,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c 2023-10-30 14:52:53,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 067dfd97cc9f142313f90d932310385c 2023-10-30 14:52:53,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:52:53,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 067dfd97cc9f142313f90d932310385c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75283377, jitterRate=0.12180973589420319}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 14:52:53,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:52:53,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c., pid=11, masterSystemTime=1698677573464 2023-10-30 14:52:53,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:53,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:53,525 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=067dfd97cc9f142313f90d932310385c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:53,525 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698677573525"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677573525"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677573525"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677573525"}]},"ts":"1698677573525"} 2023-10-30 14:52:53,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-30 14:52:53,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 067dfd97cc9f142313f90d932310385c, server=jenkins-hbase20.apache.org,36359,1698677568317 in 219 msec 2023-10-30 14:52:53,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-30 14:52:53,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=067dfd97cc9f142313f90d932310385c, ASSIGN in 383 msec 2023-10-30 14:52:53,543 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 14:52:53,543 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677573543"}]},"ts":"1698677573543"} 2023-10-30 14:52:53,547 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-10-30 14:52:53,550 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 14:52:53,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.2820 sec 2023-10-30 14:52:54,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-30 14:52:54,412 INFO [Listener at localhost/34621] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-10-30 14:52:54,434 DEBUG [hconnection-0x2d928fd7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:52:54,437 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:52:54,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:52:54,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:54,590 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:52:54,590 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:52:54,590 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 14:52:54,590 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 14:52:54,591 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:54,591 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:54,592 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:52:54,592 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:54,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:52:54,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:52:54,593 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:54,593 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:52:54,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:54,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:52:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:54,595 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:54,597 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:54,597 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 14:52:54,597 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:52:54,598 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 14:52:54,598 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:52:54,599 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:52:54,599 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:54,599 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. started... 2023-10-30 14:52:54,600 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 067dfd97cc9f142313f90d932310385c 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 14:52:55,130 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e82194151f584ed9a335f32f27d5a01f to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130e82194151f584ed9a335f32f27d5a01f 2023-10-30 14:52:55,545 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/2d8703fedfaf4e10b9d8d145a75a797b 2023-10-30 14:52:55,559 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/2d8703fedfaf4e10b9d8d145a75a797b as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2d8703fedfaf4e10b9d8d145a75a797b 2023-10-30 14:52:55,568 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2d8703fedfaf4e10b9d8d145a75a797b, entries=1000, sequenceid=5, filesize=175.8 K 2023-10-30 14:52:55,570 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 067dfd97cc9f142313f90d932310385c in 970ms, sequenceid=5, compaction requested=false 2023-10-30 14:52:55,572 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:52:55,575 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:52:55,575 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:55,575 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:52:55,575 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:52:55,575 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:55,576 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 14:52:55,576 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 14:52:55,578 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:55,578 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:55,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:55,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:55,579 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,579 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:52:55,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:55,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:55,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:55,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:55,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 14:52:55,581 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 14:52:55,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ebec5e4[Count = 0] remaining members to acquire global barrier 2023-10-30 14:52:55,581 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,582 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,582 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 14:52:55,582 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 14:52:55,582 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:55,582 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:52:55,582 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:52:55,584 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 14:52:55,584 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:55,584 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:52:55,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:55,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:55,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:55,584 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 14:52:55,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:55,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:55,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:55,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:55,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:55,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:52:55,587 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 14:52:55,587 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:52:55,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 14:52:55,587 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:52:55,587 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,587 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:52:55,590 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,590 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:55,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:55,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,590 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:52:55,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:55,591 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:55,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:52:55,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:52:55,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:55,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,592 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:55,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:55,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:55,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:55,602 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:55,602 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:52:55,602 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:52:55,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:52:55,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:52:55,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:52:55,602 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:52:55,602 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:52:55,603 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,603 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:55,603 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,603 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:52:55,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:52:55,603 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,605 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 14:52:55,605 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:52:55,705 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:52:55,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:52:55,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:52:55,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 14:52:55,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,742 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:52:55,743 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:52:55,743 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 14:52:55,743 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 14:52:55,744 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,744 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,744 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:52:55,744 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:55,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:52:55,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:52:55,745 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:55,745 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:52:55,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,745 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:52:55,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,746 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,746 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 14:52:55,746 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:55,746 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 14:52:55,746 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:52:55,747 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 14:52:55,748 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:52:55,748 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:52:55,749 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:55,749 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. started... 2023-10-30 14:52:55,749 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 067dfd97cc9f142313f90d932310385c 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 14:52:56,180 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282f9aa6bb6fcd46f7b6ad7bfe09d118ca to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511282f9aa6bb6fcd46f7b6ad7bfe09d118ca 2023-10-30 14:52:56,243 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 14:52:56,294 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-30 14:52:56,295 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-30 14:52:56,596 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/fdf51c1468174eabba3541312efd3880 2023-10-30 14:52:56,608 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/fdf51c1468174eabba3541312efd3880 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/fdf51c1468174eabba3541312efd3880 2023-10-30 14:52:56,618 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/fdf51c1468174eabba3541312efd3880, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 14:52:56,619 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 067dfd97cc9f142313f90d932310385c in 870ms, sequenceid=9, compaction requested=false 2023-10-30 14:52:56,620 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:52:56,620 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:56,620 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:52:56,620 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:52:56,620 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:56,620 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 14:52:56,620 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 14:52:56,622 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:56,622 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:56,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:56,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:56,623 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:56,623 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:52:56,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:56,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:56,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:56,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 14:52:56,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b182926[Count = 0] remaining members to acquire global barrier 2023-10-30 14:52:56,625 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 14:52:56,625 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,625 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,626 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 14:52:56,626 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 14:52:56,626 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:52:56,626 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:56,626 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:52:56,629 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 14:52:56,629 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:52:56,629 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:56,629 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 14:52:56,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:56,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:56,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:56,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:56,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:56,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:56,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:56,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:56,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:52:56,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 14:52:56,634 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 14:52:56,634 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:52:56,634 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:52:56,634 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,634 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:52:56,644 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,644 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:56,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:56,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,644 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:52:56,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:56,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:52:56,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:52:56,645 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:56,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:56,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:56,646 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:56,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:56,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:56,649 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:56,650 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:52:56,650 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:52:56,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:52:56,650 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:52:56,650 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:52:56,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:52:56,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:52:56,650 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,651 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:56,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:52:56,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:52:56,651 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,651 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,651 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,651 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 14:52:56,651 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:52:56,751 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:52:56,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:52:56,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:52:56,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 14:52:56,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,767 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:52:56,767 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:52:56,767 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 14:52:56,767 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 14:52:56,768 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,768 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,769 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:56,769 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:52:56,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:52:56,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:52:56,769 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:56,769 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:52:56,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:52:56,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,770 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,771 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 14:52:56,771 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:56,771 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 14:52:56,771 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:52:56,771 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 14:52:56,772 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:52:56,772 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:52:56,772 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:56,772 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. started... 2023-10-30 14:52:56,772 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 067dfd97cc9f142313f90d932310385c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:52:56,804 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201cfc5388a6afd4773bad6863c60c871f0 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201cfc5388a6afd4773bad6863c60c871f0 2023-10-30 14:52:57,220 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/aec89b1f4e1347fbbead6ce8f694181b 2023-10-30 14:52:57,230 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/aec89b1f4e1347fbbead6ce8f694181b as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/aec89b1f4e1347fbbead6ce8f694181b 2023-10-30 14:52:57,256 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/aec89b1f4e1347fbbead6ce8f694181b, entries=1, sequenceid=13, filesize=5.0 K 2023-10-30 14:52:57,258 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 067dfd97cc9f142313f90d932310385c in 486ms, sequenceid=13, compaction requested=true 2023-10-30 14:52:57,258 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:52:57,258 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:57,258 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:52:57,259 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:52:57,259 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,259 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 14:52:57,259 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 14:52:57,261 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,261 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:57,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:57,262 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,262 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:52:57,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:57,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:57,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:57,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 14:52:57,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@608c90f4[Count = 0] remaining members to acquire global barrier 2023-10-30 14:52:57,263 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 14:52:57,263 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,264 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,264 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 14:52:57,265 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 14:52:57,265 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:52:57,265 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,265 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:52:57,266 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 14:52:57,266 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,266 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:52:57,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:57,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:57,266 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 14:52:57,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:57,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:57,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:57,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:52:57,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 14:52:57,270 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 14:52:57,270 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:52:57,270 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:52:57,270 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,270 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:52:57,279 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,279 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,279 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:52:57,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:57,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:57,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:52:57,279 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:52:57,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:57,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:57,281 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:57,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,291 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:52:57,291 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:52:57,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:52:57,292 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,292 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,292 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:52:57,292 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,293 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:52:57,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:52:57,293 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,293 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:52:57,293 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:52:57,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:52:57,294 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 14:52:57,294 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:52:57,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 14:52:57,394 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:52:57,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:52:57,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:52:57,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 14:52:57,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,407 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:52:57,407 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:52:57,408 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 14:52:57,408 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 14:52:57,409 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,409 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,409 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:52:57,410 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:52:57,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:52:57,410 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,410 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:52:57,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:52:57,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,411 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,411 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 14:52:57,411 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,411 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 14:52:57,411 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:52:57,412 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 14:52:57,412 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:52:57,412 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:52:57,412 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:57,412 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. started... 2023-10-30 14:52:57,412 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 067dfd97cc9f142313f90d932310385c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:52:57,440 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205705a90eaf29b4216817e6634faa62a69 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205705a90eaf29b4216817e6634faa62a69 2023-10-30 14:52:57,454 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/3b9a71dc83b549a9ae9fb7a0a9b02e71 2023-10-30 14:52:57,467 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/3b9a71dc83b549a9ae9fb7a0a9b02e71 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/3b9a71dc83b549a9ae9fb7a0a9b02e71 2023-10-30 14:52:57,480 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-30 14:52:57,482 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/3b9a71dc83b549a9ae9fb7a0a9b02e71, entries=1, sequenceid=17, filesize=5.0 K 2023-10-30 14:52:57,483 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-30 14:52:57,484 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 067dfd97cc9f142313f90d932310385c in 72ms, sequenceid=17, compaction requested=true 2023-10-30 14:52:57,484 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:52:57,485 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:57,485 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:52:57,485 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:52:57,485 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,485 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 14:52:57,485 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 14:52:57,487 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,487 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:57,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:57,488 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,488 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:52:57,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:57,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:57,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:57,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 14:52:57,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5952cb50[Count = 0] remaining members to acquire global barrier 2023-10-30 14:52:57,490 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 14:52:57,490 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,493 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,494 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 14:52:57,494 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 14:52:57,494 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:52:57,494 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,494 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:52:57,496 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 14:52:57,496 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,496 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:52:57,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:57,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:57,496 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 14:52:57,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:57,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:57,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:57,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:52:57,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 14:52:57,506 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 14:52:57,506 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:52:57,507 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:52:57,507 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,507 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:52:57,510 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,510 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:52:57,510 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:57,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:57,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:52:57,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:57,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:52:57,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,512 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:57,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,514 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:57,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,525 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:52:57,525 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:52:57,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:52:57,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:52:57,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:52:57,525 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:52:57,525 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:52:57,525 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,526 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,526 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,526 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,526 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,526 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 14:52:57,526 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,526 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:52:57,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:52:57,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:52:57,626 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:52:57,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:52:57,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:52:57,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 14:52:57,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,639 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:52:57,639 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:52:57,640 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 14:52:57,640 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 14:52:57,641 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,641 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,761 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:52:57,761 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:52:57,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:52:57,762 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,762 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:52:57,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:52:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,763 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,763 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 14:52:57,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,763 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 14:52:57,763 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:52:57,764 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 14:52:57,764 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:52:57,764 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:52:57,764 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:57,764 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. started... 2023-10-30 14:52:57,764 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 067dfd97cc9f142313f90d932310385c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:52:57,796 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285c03bdabb30843e5a0769418bcb56c65 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512285c03bdabb30843e5a0769418bcb56c65 2023-10-30 14:52:57,821 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/2aa54a13aedb4826b2d087fc6786fc01 2023-10-30 14:52:57,831 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/2aa54a13aedb4826b2d087fc6786fc01 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2aa54a13aedb4826b2d087fc6786fc01 2023-10-30 14:52:57,845 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2aa54a13aedb4826b2d087fc6786fc01, entries=1, sequenceid=21, filesize=5.0 K 2023-10-30 14:52:57,847 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 067dfd97cc9f142313f90d932310385c in 83ms, sequenceid=21, compaction requested=true 2023-10-30 14:52:57,847 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:52:57,847 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:57,847 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:52:57,847 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:52:57,847 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,848 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 14:52:57,848 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 14:52:57,852 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,852 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:57,852 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,852 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:52:57,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:57,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:57,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:57,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 14:52:57,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@514bb47b[Count = 0] remaining members to acquire global barrier 2023-10-30 14:52:57,855 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 14:52:57,855 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,855 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,856 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 14:52:57,856 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 14:52:57,856 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,856 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:52:57,856 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:52:57,857 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 14:52:57,857 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,857 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:52:57,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:57,857 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 14:52:57,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:57,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:57,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:57,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:52:57,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 14:52:57,861 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 14:52:57,861 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:52:57,861 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:52:57,861 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,861 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:52:57,863 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,863 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:52:57,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,863 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:57,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:57,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:52:57,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:52:57,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:57,864 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:57,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,865 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:57,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,868 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:52:57,868 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:52:57,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:52:57,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:52:57,868 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,868 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,869 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,869 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:52:57,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 14:52:57,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:52:57,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:52:57,869 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:52:57,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:52:57,869 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,870 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,870 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,870 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 14:52:57,870 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:52:57,970 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:52:57,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:52:57,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:52:57,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 14:52:57,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,984 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:52:57,984 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:52:57,984 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 14:52:57,984 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 14:52:57,985 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,985 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,986 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,986 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:52:57,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:52:57,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:52:57,986 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:57,986 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:52:57,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:52:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,987 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,987 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 14:52:57,987 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:57,988 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 14:52:57,988 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:52:57,988 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 14:52:57,988 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:52:57,988 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:52:57,988 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:57,988 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. started... 2023-10-30 14:52:57,988 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 067dfd97cc9f142313f90d932310385c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:52:58,417 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d9bc39d912be4079a7fed16635f94ffe to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231d9bc39d912be4079a7fed16635f94ffe 2023-10-30 14:52:58,829 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/c9d5d345796d41e88a146d55fe5ae17c 2023-10-30 14:52:58,843 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/c9d5d345796d41e88a146d55fe5ae17c as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/c9d5d345796d41e88a146d55fe5ae17c 2023-10-30 14:52:58,853 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/c9d5d345796d41e88a146d55fe5ae17c, entries=1, sequenceid=25, filesize=5.0 K 2023-10-30 14:52:58,855 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 067dfd97cc9f142313f90d932310385c in 867ms, sequenceid=25, compaction requested=true 2023-10-30 14:52:58,855 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:52:58,855 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:58,855 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:52:58,857 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:52:58,857 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:58,857 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 14:52:58,857 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 14:52:58,861 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,861 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:58,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:58,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:58,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:58,861 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,861 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:52:58,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:58,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:58,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:58,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:58,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 14:52:58,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2be0e66d[Count = 0] remaining members to acquire global barrier 2023-10-30 14:52:58,864 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 14:52:58,864 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,864 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,865 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 14:52:58,865 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 14:52:58,865 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:52:58,865 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:58,865 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:52:58,866 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 14:52:58,866 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:58,866 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:52:58,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:58,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:58,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:58,866 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 14:52:58,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:58,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:58,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:58,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:58,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:58,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:52:58,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 14:52:58,871 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 14:52:58,871 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:52:58,871 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:52:58,871 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,871 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:52:58,873 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,873 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:52:58,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,873 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:58,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:58,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:52:58,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:52:58,874 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:58,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:58,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:58,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,876 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:58,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:58,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:58,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:58,883 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:52:58,883 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:52:58,883 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:58,883 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,883 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,883 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:58,883 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,883 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:52:58,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:52:58,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:52:58,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:52:58,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:52:58,883 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,885 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:58,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 14:52:58,885 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 14:52:58,885 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:52:58,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:52:58,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:52:58,985 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:52:58,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:52:58,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:52:59,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 14:52:59,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,001 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:52:59,001 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:52:59,001 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 14:52:59,001 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 14:52:59,002 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,002 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,003 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:52:59,003 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:52:59,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:52:59,004 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,004 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:52:59,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:52:59,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,005 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,005 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 14:52:59,006 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,006 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 14:52:59,006 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:52:59,006 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 14:52:59,007 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:52:59,007 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:52:59,007 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:59,007 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. started... 2023-10-30 14:52:59,007 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 067dfd97cc9f142313f90d932310385c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:52:59,074 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601018893e964049e4c42a914cae891f8a2da to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601018893e964049e4c42a914cae891f8a2da 2023-10-30 14:52:59,522 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/368899a7ffd24f7c93954907c443fcfa 2023-10-30 14:52:59,533 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/368899a7ffd24f7c93954907c443fcfa as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/368899a7ffd24f7c93954907c443fcfa 2023-10-30 14:52:59,542 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/368899a7ffd24f7c93954907c443fcfa, entries=1, sequenceid=29, filesize=5.0 K 2023-10-30 14:52:59,544 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 067dfd97cc9f142313f90d932310385c in 537ms, sequenceid=29, compaction requested=true 2023-10-30 14:52:59,544 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:52:59,544 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:59,544 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:52:59,545 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:52:59,545 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,545 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 14:52:59,545 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 14:52:59,547 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,547 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:59,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:59,547 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,547 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:52:59,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:59,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:59,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:59,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 14:52:59,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2fefd8d5[Count = 0] remaining members to acquire global barrier 2023-10-30 14:52:59,549 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 14:52:59,549 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,550 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,550 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 14:52:59,550 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 14:52:59,550 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:52:59,550 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,550 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:52:59,551 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 14:52:59,551 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,551 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:52:59,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:59,551 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 14:52:59,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:59,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:59,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:59,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:59,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:52:59,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 14:52:59,555 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 14:52:59,555 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:52:59,555 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:52:59,555 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,555 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:52:59,558 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,558 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:52:59,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,558 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:52:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:52:59,558 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:52:59,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:52:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:52:59,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:52:59,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,559 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:52:59,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,563 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,563 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:52:59,563 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,563 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:52:59,563 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:52:59,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:52:59,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:52:59,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 14:52:59,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:52:59,564 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:52:59,564 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,564 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,564 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,564 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,564 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 14:52:59,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:52:59,565 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:52:59,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:52:59,665 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:52:59,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:52:59,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:52:59,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 14:52:59,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,678 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:52:59,678 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:52:59,678 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 14:52:59,679 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 14:52:59,679 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,679 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,681 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,681 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:52:59,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:52:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:52:59,681 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:52:59,681 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:52:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:52:59,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,682 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,683 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 14:52:59,683 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:52:59,683 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 14:52:59,683 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:52:59,683 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 14:52:59,684 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:52:59,684 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:52:59,684 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:52:59,684 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. started... 2023-10-30 14:52:59,684 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 067dfd97cc9f142313f90d932310385c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:52:59,704 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031668fe9c01ad4e91ae200001e72dac01 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031668fe9c01ad4e91ae200001e72dac01 2023-10-30 14:53:00,113 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/2931bf1a7a1748eaa7a256692bad1070 2023-10-30 14:53:00,125 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/2931bf1a7a1748eaa7a256692bad1070 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2931bf1a7a1748eaa7a256692bad1070 2023-10-30 14:53:00,133 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2931bf1a7a1748eaa7a256692bad1070, entries=1, sequenceid=33, filesize=5.0 K 2023-10-30 14:53:00,135 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 067dfd97cc9f142313f90d932310385c in 451ms, sequenceid=33, compaction requested=true 2023-10-30 14:53:00,135 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:53:00,135 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:53:00,135 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:00,136 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:00,136 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:00,136 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 14:53:00,136 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 14:53:00,137 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:00,137 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:00,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:00,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:00,137 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,137 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:00,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:00,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:00,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:00,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:00,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 14:53:00,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60289e33[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:00,139 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 14:53:00,139 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,139 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,140 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 14:53:00,140 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 14:53:00,140 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:00,140 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:00,140 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:00,141 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 14:53:00,141 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:00,141 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:00,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:00,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:00,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:00,141 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 14:53:00,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:00,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:00,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:00,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:00,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:00,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:00,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 14:53:00,144 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 14:53:00,144 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:00,144 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:00,144 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,144 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:00,145 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,145 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:00,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:00,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,145 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:00,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:00,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:00,145 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:00,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:00,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:00,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:00,147 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:00,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:00,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:00,148 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:00,149 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,149 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:00,149 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:00,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:00,149 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,149 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:00,149 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,149 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,149 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:00,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 14:53:00,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:53:00,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:00,149 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:00,150 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:00,150 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:00,251 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:00,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:00,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:00,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:00,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,269 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:53:00,269 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:00,270 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 14:53:00,270 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 14:53:00,271 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,271 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,271 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:00,272 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:00,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:00,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:00,272 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:00,272 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:00,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:00,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,273 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,273 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 14:53:00,273 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:00,273 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 14:53:00,273 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:00,274 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 14:53:00,274 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:00,274 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:00,274 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:53:00,274 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. started... 2023-10-30 14:53:00,274 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 067dfd97cc9f142313f90d932310385c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:00,697 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090759c931d119804d0a8ed33260163b40c1 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015090759c931d119804d0a8ed33260163b40c1 2023-10-30 14:53:01,112 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/f153fddc3b004723afec6b3d30791e67 2023-10-30 14:53:01,123 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/f153fddc3b004723afec6b3d30791e67 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/f153fddc3b004723afec6b3d30791e67 2023-10-30 14:53:01,144 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/f153fddc3b004723afec6b3d30791e67, entries=1, sequenceid=37, filesize=5.0 K 2023-10-30 14:53:01,146 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 067dfd97cc9f142313f90d932310385c in 872ms, sequenceid=37, compaction requested=true 2023-10-30 14:53:01,146 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:53:01,146 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:53:01,146 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:01,147 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:01,147 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,147 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 14:53:01,147 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 14:53:01,148 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,149 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:01,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:01,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:01,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:01,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,151 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,151 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:01,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:01,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 14:53:01,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c4c0621[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:01,152 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 14:53:01,152 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,158 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,158 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 14:53:01,158 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 14:53:01,158 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:01,158 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,158 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:01,159 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:01,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:01,160 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 14:53:01,160 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:01,160 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 14:53:01,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:01,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:01,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:01,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:01,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 14:53:01,163 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 14:53:01,164 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:01,164 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:01,164 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,164 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:01,168 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,169 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,169 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:01,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:01,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:01,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:01,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:01,170 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:01,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:01,171 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:01,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,177 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:01,177 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:01,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:01,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:01,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:01,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:01,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 14:53:01,181 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,181 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,181 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,181 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,181 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,182 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,182 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,182 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:01,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:53:01,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:01,183 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:01,183 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:01,283 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:01,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:01,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:01,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:01,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,310 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:53:01,311 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:01,311 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 14:53:01,311 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 14:53:01,312 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,312 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,313 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,313 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:01,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:01,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:01,314 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,314 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:01,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:01,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,315 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,315 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 14:53:01,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,315 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 14:53:01,315 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:01,316 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 14:53:01,317 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:01,317 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:01,317 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:53:01,317 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. started... 2023-10-30 14:53:01,317 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 067dfd97cc9f142313f90d932310385c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:01,371 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b71b05fb345c493d91dba00fce97185c to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b71b05fb345c493d91dba00fce97185c 2023-10-30 14:53:01,389 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/dc3acaddac60472fa544229ffbcb806b 2023-10-30 14:53:01,403 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/dc3acaddac60472fa544229ffbcb806b as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/dc3acaddac60472fa544229ffbcb806b 2023-10-30 14:53:01,414 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/dc3acaddac60472fa544229ffbcb806b, entries=1, sequenceid=41, filesize=5.0 K 2023-10-30 14:53:01,416 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 067dfd97cc9f142313f90d932310385c in 99ms, sequenceid=41, compaction requested=true 2023-10-30 14:53:01,416 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:53:01,416 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:53:01,416 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:01,417 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:01,417 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,417 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 14:53:01,417 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 14:53:01,418 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,418 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:01,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:01,419 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,419 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:01,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:01,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:01,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:01,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 14:53:01,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40b3564b[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:01,421 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 14:53:01,421 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,423 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,423 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 14:53:01,423 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 14:53:01,423 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:01,423 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,424 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:01,425 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 14:53:01,425 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:01,425 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 14:53:01,426 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:01,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:01,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:01,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:01,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:01,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:01,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 14:53:01,432 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 14:53:01,432 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:01,432 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:01,432 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,432 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:01,435 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,436 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,436 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:01,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:01,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:01,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:01,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:01,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:01,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,449 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:01,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,451 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:01,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,469 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:01,469 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:01,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:01,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:01,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:01,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:01,470 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,470 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,470 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 14:53:01,470 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:01,471 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:01,471 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,471 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,471 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 14:53:01,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:01,472 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:01,472 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:01,572 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:01,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:01,581 DEBUG [Listener at localhost/34621] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-30 14:53:01,586 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-30 14:53:01,590 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43911] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:01,607 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 14:53:01,608 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 14:53:01,611 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698678181610 2023-10-30 14:53:01,618 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:53:01,620 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 14:53:01,626 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-10-30 14:53:01,626 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 14:53:01,628 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] zookeeper.ReadOnlyZKClient(139): Connect 0x59325066 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:53:01,645 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@850f776, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:53:01,650 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:01,885 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b2c7cfb0ef754ffe851499d055a2d398 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b2c7cfb0ef754ffe851499d055a2d398 2023-10-30 14:53:01,888 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 14:53:01,917 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:53:01,919 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:53:01,957 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 14:53:01,967 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 14:53:02,035 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/156c2815112248b6b1df4fadd8b46f25 first=Optional[r3] last=Optional[r6] 2023-10-30 14:53:02,053 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/156c2815112248b6b1df4fadd8b46f25}] 2023-10-30 14:53:02,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/156c2815112248b6b1df4fadd8b46f25 for inclusion in 067dfd97cc9f142313f90d932310385c/family1 2023-10-30 14:53:02,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-30 14:53:02,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:53:02,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:53:02,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/156c2815112248b6b1df4fadd8b46f25 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__im2gpim1a7fvdfimrtdjliu0bkuqpfa568b6go798luvhu0qu1egm2dumt71e2n4/family1/156c2815112248b6b1df4fadd8b46f25 2023-10-30 14:53:02,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__im2gpim1a7fvdfimrtdjliu0bkuqpfa568b6go798luvhu0qu1egm2dumt71e2n4/family1/156c2815112248b6b1df4fadd8b46f25 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/a8e54ef227d04b9292e9a20635655adc_SeqId_44_ 2023-10-30 14:53:02,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__im2gpim1a7fvdfimrtdjliu0bkuqpfa568b6go798luvhu0qu1egm2dumt71e2n4/family1/156c2815112248b6b1df4fadd8b46f25 into 067dfd97cc9f142313f90d932310385c/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/a8e54ef227d04b9292e9a20635655adc_SeqId_44_ - updating store file list. 2023-10-30 14:53:02,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/a8e54ef227d04b9292e9a20635655adc_SeqId_44_ into 067dfd97cc9f142313f90d932310385c/family1 2023-10-30 14:53:02,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__im2gpim1a7fvdfimrtdjliu0bkuqpfa568b6go798luvhu0qu1egm2dumt71e2n4/family1/156c2815112248b6b1df4fadd8b46f25 into 067dfd97cc9f142313f90d932310385c/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/a8e54ef227d04b9292e9a20635655adc_SeqId_44_) 2023-10-30 14:53:02,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__im2gpim1a7fvdfimrtdjliu0bkuqpfa568b6go798luvhu0qu1egm2dumt71e2n4/family1/156c2815112248b6b1df4fadd8b46f25 2023-10-30 14:53:02,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 14:53:02,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 14:53:02,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(1912): 067dfd97cc9f142313f90d932310385c/family1 is initiating minor compaction 2023-10-30 14:53:02,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@166b73c7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:53:02,129 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 067dfd97cc9f142313f90d932310385c/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:53:02,130 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/fdf51c1468174eabba3541312efd3880, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/aec89b1f4e1347fbbead6ce8f694181b, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/3b9a71dc83b549a9ae9fb7a0a9b02e71, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2aa54a13aedb4826b2d087fc6786fc01, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/c9d5d345796d41e88a146d55fe5ae17c, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/368899a7ffd24f7c93954907c443fcfa, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2931bf1a7a1748eaa7a256692bad1070, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/f153fddc3b004723afec6b3d30791e67, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/dc3acaddac60472fa544229ffbcb806b, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/a8e54ef227d04b9292e9a20635655adc_SeqId_44_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp, totalSize=50.2 K 2023-10-30 14:53:02,133 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting fdf51c1468174eabba3541312efd3880, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 14:53:02,134 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting aec89b1f4e1347fbbead6ce8f694181b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 14:53:02,134 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 3b9a71dc83b549a9ae9fb7a0a9b02e71, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 14:53:02,134 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 2aa54a13aedb4826b2d087fc6786fc01, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 14:53:02,134 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting c9d5d345796d41e88a146d55fe5ae17c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 14:53:02,134 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 368899a7ffd24f7c93954907c443fcfa, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 14:53:02,134 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 2931bf1a7a1748eaa7a256692bad1070, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 14:53:02,134 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting f153fddc3b004723afec6b3d30791e67, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 14:53:02,134 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting dc3acaddac60472fa544229ffbcb806b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 14:53:02,135 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting a8e54ef227d04b9292e9a20635655adc_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 14:53:02,147 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 14:53:02,159 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:02,171 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512285c03bdabb30843e5a0769418bcb56c65 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512285c03bdabb30843e5a0769418bcb56c65 2023-10-30 14:53:02,176 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231d9bc39d912be4079a7fed16635f94ffe to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231d9bc39d912be4079a7fed16635f94ffe 2023-10-30 14:53:02,181 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601018893e964049e4c42a914cae891f8a2da to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601018893e964049e4c42a914cae891f8a2da 2023-10-30 14:53:02,184 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031668fe9c01ad4e91ae200001e72dac01 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031668fe9c01ad4e91ae200001e72dac01 2023-10-30 14:53:02,184 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-10-30 14:53:02,184 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-30 14:53:02,185 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:02,185 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:02,186 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:02,186 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:02,186 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:02,186 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:02,186 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:02,186 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:02,397 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] throttle.PressureAwareThroughputController(145): 067dfd97cc9f142313f90d932310385c#family1#compaction#10 average throughput is 0.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:53:02,479 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e43cdb81c76b4222b945e67df0b32db0 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205e43cdb81c76b4222b945e67df0b32db0 2023-10-30 14:53:02,481 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 14:53:02,573 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9c6cc5cf2c744f30babbd3374f5838c4 first=Optional[r00] last=Optional[r2] 2023-10-30 14:53:02,574 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9c6cc5cf2c744f30babbd3374f5838c4}] 2023-10-30 14:53:02,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9c6cc5cf2c744f30babbd3374f5838c4 for inclusion in 067dfd97cc9f142313f90d932310385c/family1 2023-10-30 14:53:02,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-30 14:53:02,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:53:02,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:53:02,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9c6cc5cf2c744f30babbd3374f5838c4 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__epd4ubktabjqf9qaipa6rhtj6kgm5427j1dqmrbklp60ttn2rgqio97jbsvfuejh/family1/9c6cc5cf2c744f30babbd3374f5838c4 2023-10-30 14:53:02,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__epd4ubktabjqf9qaipa6rhtj6kgm5427j1dqmrbklp60ttn2rgqio97jbsvfuejh/family1/9c6cc5cf2c744f30babbd3374f5838c4 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/894b9db2a4274e058fc55cc82052dd30_SeqId_46_ 2023-10-30 14:53:02,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__epd4ubktabjqf9qaipa6rhtj6kgm5427j1dqmrbklp60ttn2rgqio97jbsvfuejh/family1/9c6cc5cf2c744f30babbd3374f5838c4 into 067dfd97cc9f142313f90d932310385c/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/894b9db2a4274e058fc55cc82052dd30_SeqId_46_ - updating store file list. 2023-10-30 14:53:02,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/894b9db2a4274e058fc55cc82052dd30_SeqId_46_ into 067dfd97cc9f142313f90d932310385c/family1 2023-10-30 14:53:02,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__epd4ubktabjqf9qaipa6rhtj6kgm5427j1dqmrbklp60ttn2rgqio97jbsvfuejh/family1/9c6cc5cf2c744f30babbd3374f5838c4 into 067dfd97cc9f142313f90d932310385c/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/894b9db2a4274e058fc55cc82052dd30_SeqId_46_) 2023-10-30 14:53:02,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__epd4ubktabjqf9qaipa6rhtj6kgm5427j1dqmrbklp60ttn2rgqio97jbsvfuejh/family1/9c6cc5cf2c744f30babbd3374f5838c4 2023-10-30 14:53:02,603 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 14:53:02,605 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:02,609 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130e82194151f584ed9a335f32f27d5a01f to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130e82194151f584ed9a335f32f27d5a01f 2023-10-30 14:53:02,612 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201cfc5388a6afd4773bad6863c60c871f0 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201cfc5388a6afd4773bad6863c60c871f0 2023-10-30 14:53:02,614 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205705a90eaf29b4216817e6634faa62a69 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205705a90eaf29b4216817e6634faa62a69 2023-10-30 14:53:02,614 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-10-30 14:53:02,614 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-30 14:53:02,615 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:02,616 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 14:53:02,616 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:53:02,617 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 14:53:02,632 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.0170 sec 2023-10-30 14:53:02,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-30 14:53:02,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:02,951 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-10-30 14:53:02,954 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-10-30 14:53:02,954 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-10-30 14:53:02,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-10-30 14:53:02,963 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/66371df266504e16b43214f3cd46537d as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/66371df266504e16b43214f3cd46537d 2023-10-30 14:53:02,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=067dfd97cc9f142313f90d932310385c, REOPEN/MOVE}] 2023-10-30 14:53:02,997 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=067dfd97cc9f142313f90d932310385c, REOPEN/MOVE 2023-10-30 14:53:03,006 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=067dfd97cc9f142313f90d932310385c, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:03,007 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698677583006"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677583006"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677583006"}]},"ts":"1698677583006"} 2023-10-30 14:53:03,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 067dfd97cc9f142313f90d932310385c, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:53:03,011 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 067dfd97cc9f142313f90d932310385c/family1 of 067dfd97cc9f142313f90d932310385c into 66371df266504e16b43214f3cd46537d(size=6.6 K), total size for store is 358.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:53:03,011 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:53:03,013 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1698677582121; duration=0sec 2023-10-30 14:53:03,015 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:53:03,043 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/fdf51c1468174eabba3541312efd3880, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/aec89b1f4e1347fbbead6ce8f694181b, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/3b9a71dc83b549a9ae9fb7a0a9b02e71, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2aa54a13aedb4826b2d087fc6786fc01, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/c9d5d345796d41e88a146d55fe5ae17c, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/368899a7ffd24f7c93954907c443fcfa, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2931bf1a7a1748eaa7a256692bad1070, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/f153fddc3b004723afec6b3d30791e67, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/dc3acaddac60472fa544229ffbcb806b, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/a8e54ef227d04b9292e9a20635655adc_SeqId_44_] to archive 2023-10-30 14:53:03,046 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:03,052 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/fdf51c1468174eabba3541312efd3880 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/fdf51c1468174eabba3541312efd3880 2023-10-30 14:53:03,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/aec89b1f4e1347fbbead6ce8f694181b to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/aec89b1f4e1347fbbead6ce8f694181b 2023-10-30 14:53:03,057 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/3b9a71dc83b549a9ae9fb7a0a9b02e71 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/3b9a71dc83b549a9ae9fb7a0a9b02e71 2023-10-30 14:53:03,059 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2aa54a13aedb4826b2d087fc6786fc01 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2aa54a13aedb4826b2d087fc6786fc01 2023-10-30 14:53:03,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/c9d5d345796d41e88a146d55fe5ae17c to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/c9d5d345796d41e88a146d55fe5ae17c 2023-10-30 14:53:03,063 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/368899a7ffd24f7c93954907c443fcfa to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/368899a7ffd24f7c93954907c443fcfa 2023-10-30 14:53:03,065 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2931bf1a7a1748eaa7a256692bad1070 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2931bf1a7a1748eaa7a256692bad1070 2023-10-30 14:53:03,068 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/f153fddc3b004723afec6b3d30791e67 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/f153fddc3b004723afec6b3d30791e67 2023-10-30 14:53:03,070 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/dc3acaddac60472fa544229ffbcb806b to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/dc3acaddac60472fa544229ffbcb806b 2023-10-30 14:53:03,072 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/a8e54ef227d04b9292e9a20635655adc_SeqId_44_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/a8e54ef227d04b9292e9a20635655adc_SeqId_44_ 2023-10-30 14:53:03,175 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:03,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 067dfd97cc9f142313f90d932310385c 2023-10-30 14:53:03,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 067dfd97cc9f142313f90d932310385c, disabling compactions & flushes 2023-10-30 14:53:03,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:53:03,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:53:03,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. after waiting 0 ms 2023-10-30 14:53:03,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:53:03,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-10-30 14:53:03,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:53:03,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:53:03,192 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 067dfd97cc9f142313f90d932310385c to self. 2023-10-30 14:53:03,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 067dfd97cc9f142313f90d932310385c 2023-10-30 14:53:03,196 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=067dfd97cc9f142313f90d932310385c, regionState=CLOSED 2023-10-30 14:53:03,196 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698677583195"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677583195"}]},"ts":"1698677583195"} 2023-10-30 14:53:03,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-10-30 14:53:03,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 067dfd97cc9f142313f90d932310385c, server=jenkins-hbase20.apache.org,36359,1698677568317 in 194 msec 2023-10-30 14:53:03,209 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=067dfd97cc9f142313f90d932310385c, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=true 2023-10-30 14:53:03,360 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=067dfd97cc9f142313f90d932310385c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:03,360 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698677583360"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677583360"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677583360"}]},"ts":"1698677583360"} 2023-10-30 14:53:03,363 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 067dfd97cc9f142313f90d932310385c, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:53:03,516 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:03,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:53:03,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 067dfd97cc9f142313f90d932310385c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c.', STARTKEY => '', ENDKEY => ''} 2023-10-30 14:53:03,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 067dfd97cc9f142313f90d932310385c 2023-10-30 14:53:03,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:53:03,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 067dfd97cc9f142313f90d932310385c 2023-10-30 14:53:03,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 067dfd97cc9f142313f90d932310385c 2023-10-30 14:53:03,523 INFO [StoreOpener-067dfd97cc9f142313f90d932310385c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 067dfd97cc9f142313f90d932310385c 2023-10-30 14:53:03,524 DEBUG [StoreOpener-067dfd97cc9f142313f90d932310385c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1 2023-10-30 14:53:03,524 DEBUG [StoreOpener-067dfd97cc9f142313f90d932310385c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1 2023-10-30 14:53:03,525 INFO [StoreOpener-067dfd97cc9f142313f90d932310385c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 067dfd97cc9f142313f90d932310385c columnFamilyName family1 2023-10-30 14:53:03,534 DEBUG [StoreOpener-067dfd97cc9f142313f90d932310385c-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2d8703fedfaf4e10b9d8d145a75a797b 2023-10-30 14:53:03,541 DEBUG [StoreOpener-067dfd97cc9f142313f90d932310385c-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/66371df266504e16b43214f3cd46537d 2023-10-30 14:53:03,547 DEBUG [StoreOpener-067dfd97cc9f142313f90d932310385c-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/894b9db2a4274e058fc55cc82052dd30_SeqId_46_ 2023-10-30 14:53:03,548 INFO [StoreOpener-067dfd97cc9f142313f90d932310385c-1] regionserver.HStore(310): Store=067dfd97cc9f142313f90d932310385c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:53:03,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c 2023-10-30 14:53:03,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c 2023-10-30 14:53:03,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 067dfd97cc9f142313f90d932310385c 2023-10-30 14:53:03,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 067dfd97cc9f142313f90d932310385c; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61003133, jitterRate=-0.09098248183727264}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 14:53:03,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:53:03,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c., pid=17, masterSystemTime=1698677583516 2023-10-30 14:53:03,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:53:03,559 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 14:53:03,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:53:03,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:53:03,562 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 14:53:03,562 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1912): 067dfd97cc9f142313f90d932310385c/family1 is initiating minor compaction (all files) 2023-10-30 14:53:03,562 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 067dfd97cc9f142313f90d932310385c/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:53:03,562 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=067dfd97cc9f142313f90d932310385c, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:03,563 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2d8703fedfaf4e10b9d8d145a75a797b, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/66371df266504e16b43214f3cd46537d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/894b9db2a4274e058fc55cc82052dd30_SeqId_46_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp, totalSize=358.6 K 2023-10-30 14:53:03,563 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698677583562"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677583562"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677583562"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677583562"}]},"ts":"1698677583562"} 2023-10-30 14:53:03,564 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 2d8703fedfaf4e10b9d8d145a75a797b, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878852219 2023-10-30 14:53:03,564 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 66371df266504e16b43214f3cd46537d, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621252219 2023-10-30 14:53:03,565 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 894b9db2a4274e058fc55cc82052dd30_SeqId_46_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878852219 2023-10-30 14:53:03,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-10-30 14:53:03,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 067dfd97cc9f142313f90d932310385c, server=jenkins-hbase20.apache.org,36359,1698677568317 in 202 msec 2023-10-30 14:53:03,572 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-30 14:53:03,572 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=067dfd97cc9f142313f90d932310385c, REOPEN/MOVE in 574 msec 2023-10-30 14:53:03,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-10-30 14:53:03,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 614 msec 2023-10-30 14:53:03,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 675 msec 2023-10-30 14:53:03,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-10-30 14:53:03,596 INFO [Listener at localhost/34621] compactions.TestMobCompactor(278): alter status finished 2023-10-30 14:53:03,598 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43911] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 14:53:03,601 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 14:53:03,609 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] throttle.PressureAwareThroughputController(145): 067dfd97cc9f142313f90d932310385c#family1#compaction#11 average throughput is 5.16 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:53:03,612 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 14:53:03,618 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698678183618 2023-10-30 14:53:03,619 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:53:03,620 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 14:53:03,621 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-10-30 14:53:03,621 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 14:53:03,623 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] zookeeper.ReadOnlyZKClient(139): Connect 0x1e62cd1c to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:53:03,638 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70d3cf85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:53:03,638 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:03,638 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:03,638 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:03,638 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:03,638 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:04,088 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112862e0e5e9e9ec44a98b2274f60923f5e6 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112862e0e5e9e9ec44a98b2274f60923f5e6 2023-10-30 14:53:04,089 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 14:53:04,107 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:53:04,108 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:53:04,118 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 14:53:04,120 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 14:53:04,136 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/92ac594ebf144627987a79d5cd43e627 first=Optional[r05] last=Optional[r8] 2023-10-30 14:53:04,137 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=50 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/92ac594ebf144627987a79d5cd43e627}] 2023-10-30 14:53:04,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/92ac594ebf144627987a79d5cd43e627 for inclusion in 067dfd97cc9f142313f90d932310385c/family1 2023-10-30 14:53:04,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-30 14:53:04,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:53:04,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:53:04,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/92ac594ebf144627987a79d5cd43e627 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m08jr6nta9fvt8vjif4lfi0reubd4a0660qhsj5u5t7jj36os7810e5i42fdjsm9/family1/92ac594ebf144627987a79d5cd43e627 2023-10-30 14:53:04,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m08jr6nta9fvt8vjif4lfi0reubd4a0660qhsj5u5t7jj36os7810e5i42fdjsm9/family1/92ac594ebf144627987a79d5cd43e627 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/db2237461d6c43a584fb03d1f2e7ffe0_SeqId_52_ 2023-10-30 14:53:04,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m08jr6nta9fvt8vjif4lfi0reubd4a0660qhsj5u5t7jj36os7810e5i42fdjsm9/family1/92ac594ebf144627987a79d5cd43e627 into 067dfd97cc9f142313f90d932310385c/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/db2237461d6c43a584fb03d1f2e7ffe0_SeqId_52_ - updating store file list. 2023-10-30 14:53:04,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/db2237461d6c43a584fb03d1f2e7ffe0_SeqId_52_ into 067dfd97cc9f142313f90d932310385c/family1 2023-10-30 14:53:04,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m08jr6nta9fvt8vjif4lfi0reubd4a0660qhsj5u5t7jj36os7810e5i42fdjsm9/family1/92ac594ebf144627987a79d5cd43e627 into 067dfd97cc9f142313f90d932310385c/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/db2237461d6c43a584fb03d1f2e7ffe0_SeqId_52_) 2023-10-30 14:53:04,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m08jr6nta9fvt8vjif4lfi0reubd4a0660qhsj5u5t7jj36os7810e5i42fdjsm9/family1/92ac594ebf144627987a79d5cd43e627 2023-10-30 14:53:04,170 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 14:53:04,171 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:04,173 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b71b05fb345c493d91dba00fce97185c to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b71b05fb345c493d91dba00fce97185c 2023-10-30 14:53:04,175 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511282f9aa6bb6fcd46f7b6ad7bfe09d118ca to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511282f9aa6bb6fcd46f7b6ad7bfe09d118ca 2023-10-30 14:53:04,175 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-10-30 14:53:04,175 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-30 14:53:04,176 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:04,176 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:04,176 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 14:53:04,176 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 14:53:04,176 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:53:04,177 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 14:53:04,180 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 579 msec 2023-10-30 14:53:04,317 INFO [Listener at localhost/34621] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=254 (was 210) Potentially hanging thread: hconnection-0x52ef4489-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1805892454_17 at /127.0.0.1:39988 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-1606791183-148.251.75.209-1698677564337:blk_1073741865_1041, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_438394506_17 at /127.0.0.1:39866 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49804@0x1e62cd1c-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x14d8a62d-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ef4489-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_438394506_17 at /127.0.0.1:39824 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_438394506_17 at /127.0.0.1:52868 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120506e4fd518e5343babdb6f612cdac888a java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/6856b3be31804f2489def1df5b857d7b block BP-1606791183-148.251.75.209-1698677564337:blk_1073741865_1041 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_438394506_17 at /127.0.0.1:39838 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ef4489-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_438394506_17 at /127.0.0.1:52880 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49804@0x1e62cd1c sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1527453623.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_438394506_17 at /127.0.0.1:39908 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x14d8a62d-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1805892454_17 at /127.0.0.1:52968 [Receiving block BP-1606791183-148.251.75.209-1698677564337:blk_1073741865_1041] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_438394506_17 at /127.0.0.1:39806 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_438394506_17 at /127.0.0.1:52908 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_438394506_17 at /127.0.0.1:39920 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x14d8a62d-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49804@0x59325066-SendThread(127.0.0.1:49804) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49804@0x59325066 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1527453623.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49804@0x1e62cd1c-SendThread(127.0.0.1:49804) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x14d8a62d-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x14d8a62d-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-1606791183-148.251.75.209-1698677564337:blk_1073741865_1041 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase20:36359-shortCompactions-0 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:940) org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:880) org.apache.hadoop.hdfs.DFSOutputStream.closeImpl(DFSOutputStream.java:863) org.apache.hadoop.hdfs.DFSOutputStream.close(DFSOutputStream.java:818) org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:72) org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:106) org.apache.hadoop.hbase.io.hfile.HFileWriterImpl.finishClose(HFileWriterImpl.java:820) org.apache.hadoop.hbase.io.hfile.HFileWriterImpl.close(HFileWriterImpl.java:654) org.apache.hadoop.hbase.regionserver.StoreFileWriter.close(StoreFileWriter.java:359) org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor.abortWriter(DefaultCompactor.java:97) org.apache.hadoop.hbase.mob.DefaultMobStoreCompactor.performCompaction(DefaultMobStoreCompactor.java:350) org.apache.hadoop.hbase.regionserver.compactions.Compactor.compact(Compactor.java:337) org.apache.hadoop.hbase.mob.DefaultMobStoreCompactor.compact(DefaultMobStoreCompactor.java:108) org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext.compact(DefaultStoreEngine.java:122) org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1473) org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:2267) org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.doCompaction(CompactSplit.java:625) org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.run(CompactSplit.java:673) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49804@0x59325066-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_438394506_17 at /127.0.0.1:39972 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_438394506_17 at /127.0.0.1:39990 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_438394506_17 at /127.0.0.1:52962 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_438394506_17 at /127.0.0.1:39906 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_438394506_17 at /127.0.0.1:39964 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=601 (was 478) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=320 (was 304) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=2456 (was 2519) 2023-10-30 14:53:04,329 INFO [Listener at localhost/34621] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=254, OpenFileDescriptor=601, MaxFileDescriptor=60000, SystemLoadAverage=320, ProcessCount=169, AvailableMemoryMB=2455 2023-10-30 14:53:04,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-30 14:53:04,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:04,336 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 14:53:04,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-10-30 14:53:04,337 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 14:53:04,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-30 14:53:04,340 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c 2023-10-30 14:53:04,340 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c empty. 2023-10-30 14:53:04,341 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c 2023-10-30 14:53:04,341 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-10-30 14:53:04,358 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-30 14:53:04,360 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 575c0b5fb7911565c72999b4af89996c, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:53:04,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-30 14:53:04,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-30 14:53:04,780 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:53:04,780 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 575c0b5fb7911565c72999b4af89996c, disabling compactions & flushes 2023-10-30 14:53:04,780 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:04,780 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:04,780 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. after waiting 0 ms 2023-10-30 14:53:04,780 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:04,781 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:04,781 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:53:04,784 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 14:53:04,785 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698677584785"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677584785"}]},"ts":"1698677584785"} 2023-10-30 14:53:04,787 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 14:53:04,789 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 14:53:04,789 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677584789"}]},"ts":"1698677584789"} 2023-10-30 14:53:04,791 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-10-30 14:53:04,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=575c0b5fb7911565c72999b4af89996c, ASSIGN}] 2023-10-30 14:53:04,795 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=575c0b5fb7911565c72999b4af89996c, ASSIGN 2023-10-30 14:53:04,797 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=575c0b5fb7911565c72999b4af89996c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:53:04,872 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/.tmp/family1/6856b3be31804f2489def1df5b857d7b as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/6856b3be31804f2489def1df5b857d7b 2023-10-30 14:53:04,882 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 067dfd97cc9f142313f90d932310385c/family1 of 067dfd97cc9f142313f90d932310385c into 6856b3be31804f2489def1df5b857d7b(size=177.2 K), total size for store is 182.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:53:04,882 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:53:04,882 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c., storeName=067dfd97cc9f142313f90d932310385c/family1, priority=13, startTime=1698677583558; duration=1sec 2023-10-30 14:53:04,882 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:53:04,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2d8703fedfaf4e10b9d8d145a75a797b, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/66371df266504e16b43214f3cd46537d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/894b9db2a4274e058fc55cc82052dd30_SeqId_46_] to archive 2023-10-30 14:53:04,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:04,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2d8703fedfaf4e10b9d8d145a75a797b to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/2d8703fedfaf4e10b9d8d145a75a797b 2023-10-30 14:53:04,927 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/66371df266504e16b43214f3cd46537d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/66371df266504e16b43214f3cd46537d 2023-10-30 14:53:04,929 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/894b9db2a4274e058fc55cc82052dd30_SeqId_46_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/family1/894b9db2a4274e058fc55cc82052dd30_SeqId_46_ 2023-10-30 14:53:04,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-30 14:53:04,948 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=575c0b5fb7911565c72999b4af89996c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:04,948 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698677584948"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677584948"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677584948"}]},"ts":"1698677584948"} 2023-10-30 14:53:04,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 575c0b5fb7911565c72999b4af89996c, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:53:05,102 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:05,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:05,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 575c0b5fb7911565c72999b4af89996c, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c.', STARTKEY => '', ENDKEY => ''} 2023-10-30 14:53:05,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 575c0b5fb7911565c72999b4af89996c 2023-10-30 14:53:05,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:53:05,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 575c0b5fb7911565c72999b4af89996c 2023-10-30 14:53:05,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 575c0b5fb7911565c72999b4af89996c 2023-10-30 14:53:05,108 INFO [StoreOpener-575c0b5fb7911565c72999b4af89996c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 575c0b5fb7911565c72999b4af89996c 2023-10-30 14:53:05,110 DEBUG [StoreOpener-575c0b5fb7911565c72999b4af89996c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1 2023-10-30 14:53:05,110 DEBUG [StoreOpener-575c0b5fb7911565c72999b4af89996c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1 2023-10-30 14:53:05,111 INFO [StoreOpener-575c0b5fb7911565c72999b4af89996c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 575c0b5fb7911565c72999b4af89996c columnFamilyName family1 2023-10-30 14:53:05,112 INFO [StoreOpener-575c0b5fb7911565c72999b4af89996c-1] regionserver.HStore(310): Store=575c0b5fb7911565c72999b4af89996c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:53:05,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c 2023-10-30 14:53:05,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c 2023-10-30 14:53:05,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 575c0b5fb7911565c72999b4af89996c 2023-10-30 14:53:05,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:53:05,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 575c0b5fb7911565c72999b4af89996c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63205776, jitterRate=-0.05816054344177246}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 14:53:05,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:53:05,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c., pid=21, masterSystemTime=1698677585102 2023-10-30 14:53:05,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:05,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:05,122 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=575c0b5fb7911565c72999b4af89996c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:05,122 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698677585122"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677585122"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677585122"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677585122"}]},"ts":"1698677585122"} 2023-10-30 14:53:05,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-10-30 14:53:05,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 575c0b5fb7911565c72999b4af89996c, server=jenkins-hbase20.apache.org,36359,1698677568317 in 174 msec 2023-10-30 14:53:05,129 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-10-30 14:53:05,129 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=575c0b5fb7911565c72999b4af89996c, ASSIGN in 333 msec 2023-10-30 14:53:05,130 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 14:53:05,131 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677585130"}]},"ts":"1698677585130"} 2023-10-30 14:53:05,133 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-10-30 14:53:05,135 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 14:53:05,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 802 msec 2023-10-30 14:53:05,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-30 14:53:05,445 INFO [Listener at localhost/34621] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-10-30 14:53:05,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:05,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:05,491 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:05,491 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:05,492 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:53:05,492 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:05,492 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:05,492 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:05,493 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:05,493 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:05,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:05,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:05,494 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:05,494 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:05,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:05,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:05,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:05,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:05,494 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:05,495 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:05,495 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:53:05,495 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:05,495 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:53:05,495 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:05,495 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:05,495 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:05,496 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. started... 2023-10-30 14:53:05,496 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 575c0b5fb7911565c72999b4af89996c 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 14:53:05,924 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113076a2c280144747df980853af2c7f445a to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113076a2c280144747df980853af2c7f445a 2023-10-30 14:53:06,329 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/d9ac912cb1c34cdfbf18d7cd7a2f208a 2023-10-30 14:53:06,337 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/d9ac912cb1c34cdfbf18d7cd7a2f208a as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/d9ac912cb1c34cdfbf18d7cd7a2f208a 2023-10-30 14:53:06,345 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/d9ac912cb1c34cdfbf18d7cd7a2f208a, entries=1000, sequenceid=5, filesize=166.0 K 2023-10-30 14:53:06,347 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 575c0b5fb7911565c72999b4af89996c in 850ms, sequenceid=5, compaction requested=false 2023-10-30 14:53:06,347 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:06,348 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:53:06,348 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:06,348 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:06,348 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:06,348 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:06,348 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:53:06,348 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:53:06,349 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,349 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:06,350 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,350 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:06,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:06,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:06,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:53:06,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11cb07f8[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:06,352 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:06,352 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,353 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,353 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:06,353 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:06,353 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:06,353 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:53:06,353 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:06,354 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:06,354 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:53:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:06,354 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:06,354 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:53:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:06,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:06,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:06,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:06,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:06,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:06,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:06,358 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:53:06,358 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:06,358 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:06,358 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,358 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:06,359 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,359 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:06,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:06,360 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:06,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:06,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:06,360 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:06,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:06,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,362 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:06,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:06,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:06,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:06,364 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:06,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:06,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:06,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:06,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:06,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:06,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 14:53:06,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:06,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:06,365 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:06,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:06,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:06,366 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:06,366 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:06,467 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:06,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:06,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:06,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:06,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,476 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:06,476 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:06,476 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:53:06,476 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:06,477 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,477 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,478 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:06,478 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:06,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:06,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:06,478 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:06,478 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:06,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:06,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,479 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,479 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:53:06,479 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:06,479 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:53:06,479 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:06,480 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:53:06,480 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:06,480 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:06,480 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:06,480 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. started... 2023-10-30 14:53:06,480 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 575c0b5fb7911565c72999b4af89996c 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 14:53:06,896 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d35a02665151413190c521aaf6b22626 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128d35a02665151413190c521aaf6b22626 2023-10-30 14:53:07,303 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/14010c6397614bdba9fc6e5dcf5fa3f8 2023-10-30 14:53:07,311 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/14010c6397614bdba9fc6e5dcf5fa3f8 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/14010c6397614bdba9fc6e5dcf5fa3f8 2023-10-30 14:53:07,318 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/14010c6397614bdba9fc6e5dcf5fa3f8, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 14:53:07,319 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 575c0b5fb7911565c72999b4af89996c in 839ms, sequenceid=9, compaction requested=false 2023-10-30 14:53:07,320 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:53:07,320 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:07,320 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:07,320 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:07,320 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,320 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:53:07,320 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:53:07,321 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,321 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:07,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:07,322 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,322 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:07,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:07,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:07,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:07,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:53:07,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35b6daf4[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:07,324 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:07,324 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,325 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,325 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:07,325 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:53:07,325 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:07,330 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,330 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:07,335 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:53:07,335 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,335 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:07,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:07,335 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:53:07,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:07,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:07,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:07,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:07,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:07,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:07,339 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:53:07,339 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:07,339 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:07,339 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,339 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:07,343 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,343 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:07,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:07,343 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:07,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:07,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:07,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:07,345 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:07,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,346 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:07,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,353 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,353 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,353 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 14:53:07,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:07,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:07,353 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:07,353 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,354 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,354 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,354 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,354 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,355 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:07,355 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:07,355 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:07,355 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:07,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:07,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:07,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:07,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:07,455 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:07,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:07,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:07,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:07,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,466 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:07,466 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:07,466 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:53:07,466 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:07,467 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,467 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,468 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,468 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:07,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:07,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:07,468 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,468 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:07,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,468 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:07,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,469 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,469 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:53:07,469 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,469 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:53:07,469 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:07,470 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:53:07,470 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:07,470 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:07,470 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:07,470 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. started... 2023-10-30 14:53:07,470 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 575c0b5fb7911565c72999b4af89996c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:07,492 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120168942ff494b9427da4cf17bc4783499c to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120168942ff494b9427da4cf17bc4783499c 2023-10-30 14:53:07,899 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/3ed705b6dbf04d2ab600eaf9c02cc031 2023-10-30 14:53:07,906 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/3ed705b6dbf04d2ab600eaf9c02cc031 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/3ed705b6dbf04d2ab600eaf9c02cc031 2023-10-30 14:53:07,912 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/3ed705b6dbf04d2ab600eaf9c02cc031, entries=1, sequenceid=13, filesize=4.9 K 2023-10-30 14:53:07,913 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 575c0b5fb7911565c72999b4af89996c in 443ms, sequenceid=13, compaction requested=true 2023-10-30 14:53:07,913 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:53:07,913 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:07,914 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:07,914 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:07,914 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,914 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:53:07,914 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:53:07,915 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,915 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:07,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:07,915 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,915 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:07,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:07,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:07,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:07,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:53:07,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39c7bf6d[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:07,916 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:07,917 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,917 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,917 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:07,917 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:53:07,918 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,918 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:07,918 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:07,918 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,918 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:53:07,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:07,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:07,919 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:07,919 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:53:07,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:07,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:07,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:07,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:07,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:07,922 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:53:07,922 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:07,922 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:07,922 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,922 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:07,926 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,926 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,926 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:07,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:07,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:07,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:07,927 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:07,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:07,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:07,928 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:07,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,930 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,930 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:07,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:07,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:07,930 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:07,930 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:07,930 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,930 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,931 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:07,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:07,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:07,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:07,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:07,931 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,931 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,931 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:07,931 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:07,931 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:07,932 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 14:53:08,031 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:08,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:08,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:08,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:08,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,042 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:08,042 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:08,042 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:53:08,042 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:08,043 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,043 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,044 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:08,044 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:08,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:08,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:08,044 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:08,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,044 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:08,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:08,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,045 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,045 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:53:08,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,045 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:53:08,045 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:08,046 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:53:08,046 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:08,046 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:08,046 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:08,046 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. started... 2023-10-30 14:53:08,046 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 575c0b5fb7911565c72999b4af89996c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:08,465 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a11ba9dafbc242f492aa3e4e1f4f7cca to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205a11ba9dafbc242f492aa3e4e1f4f7cca 2023-10-30 14:53:08,724 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 14:53:08,874 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/9adf5d5a10d44c75973bba091dff0ccf 2023-10-30 14:53:08,885 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/9adf5d5a10d44c75973bba091dff0ccf as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/9adf5d5a10d44c75973bba091dff0ccf 2023-10-30 14:53:08,895 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/9adf5d5a10d44c75973bba091dff0ccf, entries=1, sequenceid=17, filesize=4.9 K 2023-10-30 14:53:08,897 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 575c0b5fb7911565c72999b4af89996c in 851ms, sequenceid=17, compaction requested=true 2023-10-30 14:53:08,897 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:53:08,897 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:08,897 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:08,898 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:08,898 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:08,898 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:53:08,898 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:53:08,899 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:08,899 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:08,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:08,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:08,900 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,900 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:08,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:08,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:08,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:08,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:08,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:53:08,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@631ca710[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:08,902 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:08,902 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,903 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,903 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:08,903 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:53:08,903 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:08,903 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:08,903 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:08,905 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:53:08,905 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:08,905 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:08,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:08,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:08,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:08,905 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:53:08,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:08,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:08,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:08,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:08,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:08,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:08,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:08,908 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:53:08,909 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:08,909 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:08,909 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,909 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:08,924 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,924 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:08,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:08,924 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:08,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,925 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:08,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:08,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:08,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:08,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:08,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,926 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:08,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:08,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:08,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:08,928 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:08,928 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:08,928 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:08,928 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:08,928 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:08,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:08,928 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:08,928 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:08,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 14:53:08,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:08,929 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,929 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,929 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:08,929 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:08,929 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:08,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:08,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:09,030 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:09,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:09,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:09,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:09,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,040 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:09,040 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:09,040 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:53:09,040 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:09,041 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,041 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,042 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:09,042 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:09,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:09,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:09,042 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:09,042 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:09,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:09,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,043 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,043 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:53:09,043 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,043 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:53:09,043 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:09,044 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:53:09,044 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:09,044 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:09,044 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:09,044 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. started... 2023-10-30 14:53:09,044 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 575c0b5fb7911565c72999b4af89996c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:09,462 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512284ba347b80ebd42a29b7a51856789e3ba to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512284ba347b80ebd42a29b7a51856789e3ba 2023-10-30 14:53:09,868 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/ee5662ce8d1e4755816540296ea9f910 2023-10-30 14:53:09,877 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/ee5662ce8d1e4755816540296ea9f910 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/ee5662ce8d1e4755816540296ea9f910 2023-10-30 14:53:09,885 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/ee5662ce8d1e4755816540296ea9f910, entries=1, sequenceid=21, filesize=4.9 K 2023-10-30 14:53:09,886 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 575c0b5fb7911565c72999b4af89996c in 842ms, sequenceid=21, compaction requested=true 2023-10-30 14:53:09,886 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:53:09,886 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:09,886 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:09,886 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:09,886 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:09,886 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:53:09,886 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:53:09,888 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,888 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:09,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:09,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:09,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:09,888 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,889 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:09,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:09,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:09,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:09,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:09,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:53:09,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aa1984c[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:09,890 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:09,890 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,891 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,892 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:09,892 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:53:09,892 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:09,892 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:09,892 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:09,893 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:53:09,893 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:09,893 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:53:09,894 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:09,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:09,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:09,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:09,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:09,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:09,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:09,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:09,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:09,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:09,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:09,901 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:53:09,902 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:09,902 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:09,902 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,902 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:09,914 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,914 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:09,914 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:09,915 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:09,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:09,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,916 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:09,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:09,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:09,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:09,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:09,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:09,925 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:09,925 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,925 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,925 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:09,925 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,925 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,925 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:09,925 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:09,925 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:09,925 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:09,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:09,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:09,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:09,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:09,927 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:09,927 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:09,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:09,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:09,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 14:53:10,027 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:10,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:10,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:10,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:10,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,041 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:10,041 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:10,041 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:53:10,041 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:10,042 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,042 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,043 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:10,043 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:10,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:10,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:10,043 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:10,044 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:10,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:10,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,044 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,045 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:53:10,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,045 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:53:10,045 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:10,045 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:53:10,046 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:10,046 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:10,046 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:10,046 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. started... 2023-10-30 14:53:10,046 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 575c0b5fb7911565c72999b4af89996c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:10,472 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313a04d7985e8f4d1994d2113ec65ab09d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512313a04d7985e8f4d1994d2113ec65ab09d 2023-10-30 14:53:10,881 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/0be315ec6946467dbceae1dd4cc3bd95 2023-10-30 14:53:10,889 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/0be315ec6946467dbceae1dd4cc3bd95 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/0be315ec6946467dbceae1dd4cc3bd95 2023-10-30 14:53:10,896 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/0be315ec6946467dbceae1dd4cc3bd95, entries=1, sequenceid=25, filesize=4.9 K 2023-10-30 14:53:10,897 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 575c0b5fb7911565c72999b4af89996c in 851ms, sequenceid=25, compaction requested=true 2023-10-30 14:53:10,897 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:53:10,897 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:10,897 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:10,897 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:10,897 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:10,897 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:53:10,897 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:53:10,898 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,899 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:10,899 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:10,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:10,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:10,899 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:10,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:10,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:10,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:10,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:10,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:53:10,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29c38696[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:10,900 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:10,900 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,901 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,901 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:10,901 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:53:10,901 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:10,901 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:10,902 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:10,902 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:53:10,902 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:10,902 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:10,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:10,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:10,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:10,903 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:53:10,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:10,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:10,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:10,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:10,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:10,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:10,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:10,906 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:53:10,906 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:10,906 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:10,906 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,906 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:10,907 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,907 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,907 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:10,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:10,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:10,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,908 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:10,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:10,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:10,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:10,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:10,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,909 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:10,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:10,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:10,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:10,912 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:10,912 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:10,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:10,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:10,912 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:10,912 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,912 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,912 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:10,912 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:10,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:10,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:10,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 14:53:10,913 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,913 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,913 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:10,913 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:10,914 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:10,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:10,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:11,014 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:11,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:11,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:11,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:11,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,024 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:11,025 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:11,025 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:53:11,025 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:11,026 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,026 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,027 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:11,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:11,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:11,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:11,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,028 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,029 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:53:11,029 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,029 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:53:11,029 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:11,030 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:53:11,030 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:11,030 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:11,030 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:11,030 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,030 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. started... 2023-10-30 14:53:11,030 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 575c0b5fb7911565c72999b4af89996c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:11,030 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,030 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:11,049 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101a82ff26e298041e6923972b8809d90d2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101a82ff26e298041e6923972b8809d90d2 2023-10-30 14:53:11,067 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/8d713c438248430d9563f6f834cd43ef 2023-10-30 14:53:11,074 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/8d713c438248430d9563f6f834cd43ef as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/8d713c438248430d9563f6f834cd43ef 2023-10-30 14:53:11,081 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/8d713c438248430d9563f6f834cd43ef, entries=1, sequenceid=29, filesize=4.9 K 2023-10-30 14:53:11,082 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 575c0b5fb7911565c72999b4af89996c in 52ms, sequenceid=29, compaction requested=true 2023-10-30 14:53:11,083 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:53:11,083 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:11,083 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:11,083 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:11,083 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,083 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:53:11,083 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:53:11,084 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,084 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:11,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:11,085 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,085 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:11,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:11,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:11,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:11,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:53:11,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d7b6814[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:11,086 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:11,086 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,087 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,087 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:11,087 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:53:11,087 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:11,087 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,088 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:11,088 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,088 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:53:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:11,088 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:11,089 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:53:11,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:11,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:11,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:11,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:11,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:11,092 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:53:11,092 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:11,092 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:11,092 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,092 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:11,093 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,093 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:11,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:11,093 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:11,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:11,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:11,094 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:11,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:11,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,097 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:11,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,099 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,099 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:11,099 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,099 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:11,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:11,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:11,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:11,099 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:11,099 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:11,100 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,100 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,100 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,100 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,100 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:11,100 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:11,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:11,201 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:11,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:11,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:11,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:11,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,212 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:11,212 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:11,213 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:53:11,213 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:11,214 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,214 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,214 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:11,214 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:11,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:11,215 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:11,215 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:11,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:11,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,215 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,216 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:53:11,216 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:11,217 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:53:11,217 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:11,217 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:53:11,217 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:11,217 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:11,217 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:11,218 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. started... 2023-10-30 14:53:11,218 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 575c0b5fb7911565c72999b4af89996c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:11,636 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e1a94229760c46ad8e97dbab1bd58fe1 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103e1a94229760c46ad8e97dbab1bd58fe1 2023-10-30 14:53:12,045 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/b0a4a19e0db743128d33bfc59df41bdc 2023-10-30 14:53:12,053 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/b0a4a19e0db743128d33bfc59df41bdc as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/b0a4a19e0db743128d33bfc59df41bdc 2023-10-30 14:53:12,060 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/b0a4a19e0db743128d33bfc59df41bdc, entries=1, sequenceid=33, filesize=4.9 K 2023-10-30 14:53:12,061 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 575c0b5fb7911565c72999b4af89996c in 843ms, sequenceid=33, compaction requested=true 2023-10-30 14:53:12,061 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:53:12,061 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:12,061 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:12,061 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:12,061 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:12,061 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:53:12,061 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:53:12,063 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:12,063 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:12,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:12,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:12,063 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,063 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:12,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:12,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:12,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:12,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:12,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:53:12,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bd97e8c[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:12,064 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:12,065 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,066 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,067 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:12,067 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:12,067 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:12,067 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:53:12,067 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:12,068 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:53:12,068 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:12,068 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:12,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:12,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:12,068 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:53:12,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:12,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:12,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:12,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:12,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:12,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:12,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:12,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:12,071 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:53:12,071 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:12,071 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:12,071 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,071 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:12,072 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,072 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:12,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:12,072 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:12,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,073 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:12,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:12,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:12,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:12,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,074 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:12,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:12,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:12,081 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:12,081 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:12,081 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,081 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,081 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:12,081 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,081 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,081 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:12,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:12,081 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:12,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:12,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:12,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:12,081 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 14:53:12,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:12,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:12,083 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:12,083 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:12,183 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:12,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:12,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:12,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:12,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,193 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:12,193 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:12,193 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:53:12,193 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:12,194 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,194 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,195 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:12,195 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:12,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:12,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:12,195 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:12,195 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:12,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:12,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,196 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,196 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:53:12,196 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:12,196 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:53:12,196 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:12,196 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:53:12,197 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:12,197 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:12,197 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:12,197 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. started... 2023-10-30 14:53:12,197 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 575c0b5fb7911565c72999b4af89996c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:12,622 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907e88b77e5cc9a4c0cb68fbeef26180642 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907e88b77e5cc9a4c0cb68fbeef26180642 2023-10-30 14:53:13,031 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/1973d79ec518447099b12199c61059ef 2023-10-30 14:53:13,039 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/1973d79ec518447099b12199c61059ef as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/1973d79ec518447099b12199c61059ef 2023-10-30 14:53:13,046 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/1973d79ec518447099b12199c61059ef, entries=1, sequenceid=37, filesize=4.9 K 2023-10-30 14:53:13,048 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 575c0b5fb7911565c72999b4af89996c in 851ms, sequenceid=37, compaction requested=true 2023-10-30 14:53:13,048 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:53:13,048 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:13,048 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:13,048 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:13,048 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:13,048 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:53:13,048 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:53:13,049 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:13,049 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:13,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:13,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:13,050 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,050 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:13,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:13,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:13,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:13,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:13,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:53:13,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d9ce043[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:13,051 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:13,051 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,052 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,052 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:13,053 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:53:13,053 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:13,053 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:13,053 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:13,053 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:53:13,053 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:13,053 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:13,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:13,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:13,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:13,054 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:53:13,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:13,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:13,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:13,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:13,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:13,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:13,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:13,056 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:53:13,057 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:13,057 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:13,057 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,057 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:13,058 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:13,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:13,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:13,058 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:13,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,058 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,058 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:13,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:13,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:13,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:13,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:13,059 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:13,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:13,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:13,061 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:13,061 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:13,061 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:13,061 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:13,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 14:53:13,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:13,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:13,061 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:13,062 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:13,062 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:13,062 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,062 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,062 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,062 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:13,062 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:13,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:13,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:13,162 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:13,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:13,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:13,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:13,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,174 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:13,174 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:13,175 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:53:13,175 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:13,175 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,175 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,176 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:13,176 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:13,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:13,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:13,177 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:13,177 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:13,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:13,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,178 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,178 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:53:13,178 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:13,178 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:53:13,178 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:13,179 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:53:13,179 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:13,179 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:13,179 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:13,180 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. started... 2023-10-30 14:53:13,180 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 575c0b5fb7911565c72999b4af89996c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:13,598 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112006ecf3c616374265a5e2fcad3b710810 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112006ecf3c616374265a5e2fcad3b710810 2023-10-30 14:53:14,008 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/0d9b95c4051e4f9183a2990d2c31fdbf 2023-10-30 14:53:14,022 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/0d9b95c4051e4f9183a2990d2c31fdbf as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/0d9b95c4051e4f9183a2990d2c31fdbf 2023-10-30 14:53:14,030 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/0d9b95c4051e4f9183a2990d2c31fdbf, entries=1, sequenceid=41, filesize=4.9 K 2023-10-30 14:53:14,032 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 575c0b5fb7911565c72999b4af89996c in 852ms, sequenceid=41, compaction requested=true 2023-10-30 14:53:14,032 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:53:14,032 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:14,032 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:14,032 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:14,032 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:14,032 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:53:14,032 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:53:14,034 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:14,034 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:14,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:14,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:14,034 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,034 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:14,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:14,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:14,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:14,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:14,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:53:14,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@385e2050[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:14,036 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:14,036 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,036 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,037 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:14,037 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:14,037 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:14,037 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:53:14,037 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:14,038 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:14,038 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:53:14,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:14,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:14,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:14,038 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:14,038 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:53:14,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:14,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:14,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:14,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:14,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:14,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:14,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:14,040 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:53:14,040 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:14,040 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:14,040 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,040 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:14,041 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,041 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:14,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:14,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,041 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:14,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:14,042 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:14,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:14,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:14,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:14,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,043 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:14,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:14,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:14,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:14,044 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:14,044 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,044 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:14,044 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,044 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:14,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 14:53:14,044 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:14,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 14:53:14,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:14,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:14,044 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:14,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:14,046 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,046 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,046 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,046 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:14,046 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:14,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:14,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:14,147 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:14,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:14,151 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43911] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-10-30 14:53:14,154 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 14:53:14,155 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 14:53:14,157 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:53:14,157 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698678194157 2023-10-30 14:53:14,158 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 14:53:14,160 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-10-30 14:53:14,160 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 14:53:14,161 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] zookeeper.ReadOnlyZKClient(139): Connect 0x42e680fa to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:53:14,166 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ca7c0c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:53:14,166 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 14:53:15,001 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103113527022ab34f4bb7f1fd7dcbd82fd0 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103113527022ab34f4bb7f1fd7dcbd82fd0 2023-10-30 14:53:15,002 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 14:53:15,017 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:53:15,018 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48030, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:53:15,026 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 14:53:15,027 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43620, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 14:53:15,038 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7f11c9759da94c698bc90644976a4ca1 first=Optional[r5] last=Optional[r6] 2023-10-30 14:53:15,039 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7f11c9759da94c698bc90644976a4ca1}] 2023-10-30 14:53:15,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7f11c9759da94c698bc90644976a4ca1 for inclusion in 575c0b5fb7911565c72999b4af89996c/family1 2023-10-30 14:53:15,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-10-30 14:53:15,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:53:15,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:53:15,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7f11c9759da94c698bc90644976a4ca1 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithMonthlyPolicy__pkne4e40jji9lh5gvgb8nsrkdf920jtlgjn37fvppptab15r89ubgpbubjvd05aj/family1/7f11c9759da94c698bc90644976a4ca1 2023-10-30 14:53:15,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithMonthlyPolicy__pkne4e40jji9lh5gvgb8nsrkdf920jtlgjn37fvppptab15r89ubgpbubjvd05aj/family1/7f11c9759da94c698bc90644976a4ca1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/cf4fcb0993054d2390bb6592aeb97a86_SeqId_44_ 2023-10-30 14:53:15,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithMonthlyPolicy__pkne4e40jji9lh5gvgb8nsrkdf920jtlgjn37fvppptab15r89ubgpbubjvd05aj/family1/7f11c9759da94c698bc90644976a4ca1 into 575c0b5fb7911565c72999b4af89996c/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/cf4fcb0993054d2390bb6592aeb97a86_SeqId_44_ - updating store file list. 2023-10-30 14:53:15,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/cf4fcb0993054d2390bb6592aeb97a86_SeqId_44_ into 575c0b5fb7911565c72999b4af89996c/family1 2023-10-30 14:53:15,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithMonthlyPolicy__pkne4e40jji9lh5gvgb8nsrkdf920jtlgjn37fvppptab15r89ubgpbubjvd05aj/family1/7f11c9759da94c698bc90644976a4ca1 into 575c0b5fb7911565c72999b4af89996c/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/cf4fcb0993054d2390bb6592aeb97a86_SeqId_44_) 2023-10-30 14:53:15,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithMonthlyPolicy__pkne4e40jji9lh5gvgb8nsrkdf920jtlgjn37fvppptab15r89ubgpbubjvd05aj/family1/7f11c9759da94c698bc90644976a4ca1 2023-10-30 14:53:15,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 14:53:15,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 14:53:15,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(1912): 575c0b5fb7911565c72999b4af89996c/family1 is initiating minor compaction 2023-10-30 14:53:15,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@727894d4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:53:15,060 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 575c0b5fb7911565c72999b4af89996c/family1 in testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:15,060 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/14010c6397614bdba9fc6e5dcf5fa3f8, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/3ed705b6dbf04d2ab600eaf9c02cc031, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/9adf5d5a10d44c75973bba091dff0ccf, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/ee5662ce8d1e4755816540296ea9f910, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/0be315ec6946467dbceae1dd4cc3bd95, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/8d713c438248430d9563f6f834cd43ef, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/b0a4a19e0db743128d33bfc59df41bdc, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/1973d79ec518447099b12199c61059ef, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/0d9b95c4051e4f9183a2990d2c31fdbf, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/cf4fcb0993054d2390bb6592aeb97a86_SeqId_44_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp, totalSize=49.7 K 2023-10-30 14:53:15,060 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 14010c6397614bdba9fc6e5dcf5fa3f8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 14:53:15,060 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 3ed705b6dbf04d2ab600eaf9c02cc031, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 14:53:15,060 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 9adf5d5a10d44c75973bba091dff0ccf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 14:53:15,060 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting ee5662ce8d1e4755816540296ea9f910, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 14:53:15,060 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 0be315ec6946467dbceae1dd4cc3bd95, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 14:53:15,060 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 8d713c438248430d9563f6f834cd43ef, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 14:53:15,060 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting b0a4a19e0db743128d33bfc59df41bdc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 14:53:15,061 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 1973d79ec518447099b12199c61059ef, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 14:53:15,061 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 0d9b95c4051e4f9183a2990d2c31fdbf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 14:53:15,061 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting cf4fcb0993054d2390bb6592aeb97a86_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 14:53:15,062 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 14:53:15,063 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:15,065 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101a82ff26e298041e6923972b8809d90d2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101a82ff26e298041e6923972b8809d90d2 2023-10-30 14:53:15,066 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103e1a94229760c46ad8e97dbab1bd58fe1 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103e1a94229760c46ad8e97dbab1bd58fe1 2023-10-30 14:53:15,066 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-10-30 14:53:15,066 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-10-30 14:53:15,067 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 14:53:15,067 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 14:53:15,098 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] throttle.PressureAwareThroughputController(145): 575c0b5fb7911565c72999b4af89996c#family1#compaction#22 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:53:15,916 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/dde677b664e74a8a90918bd9ed1c9ea1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/dde677b664e74a8a90918bd9ed1c9ea1 2023-10-30 14:53:15,922 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 575c0b5fb7911565c72999b4af89996c/family1 of 575c0b5fb7911565c72999b4af89996c into dde677b664e74a8a90918bd9ed1c9ea1(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:53:15,922 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:53:15,923 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698677595059; duration=0sec 2023-10-30 14:53:15,923 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123143775124661d4e808a2782e6f9148f21 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123143775124661d4e808a2782e6f9148f21 2023-10-30 14:53:15,923 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:53:15,924 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 14:53:15,937 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/14010c6397614bdba9fc6e5dcf5fa3f8, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/3ed705b6dbf04d2ab600eaf9c02cc031, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/9adf5d5a10d44c75973bba091dff0ccf, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/ee5662ce8d1e4755816540296ea9f910, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/0be315ec6946467dbceae1dd4cc3bd95, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/8d713c438248430d9563f6f834cd43ef, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/b0a4a19e0db743128d33bfc59df41bdc, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/1973d79ec518447099b12199c61059ef, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/0d9b95c4051e4f9183a2990d2c31fdbf, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/cf4fcb0993054d2390bb6592aeb97a86_SeqId_44_] to archive 2023-10-30 14:53:15,938 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:15,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/14010c6397614bdba9fc6e5dcf5fa3f8 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/14010c6397614bdba9fc6e5dcf5fa3f8 2023-10-30 14:53:15,942 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/3ed705b6dbf04d2ab600eaf9c02cc031 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/3ed705b6dbf04d2ab600eaf9c02cc031 2023-10-30 14:53:15,943 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/9adf5d5a10d44c75973bba091dff0ccf to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/9adf5d5a10d44c75973bba091dff0ccf 2023-10-30 14:53:15,944 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/ee5662ce8d1e4755816540296ea9f910 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/ee5662ce8d1e4755816540296ea9f910 2023-10-30 14:53:15,946 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/0be315ec6946467dbceae1dd4cc3bd95 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/0be315ec6946467dbceae1dd4cc3bd95 2023-10-30 14:53:15,947 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/8d713c438248430d9563f6f834cd43ef to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/8d713c438248430d9563f6f834cd43ef 2023-10-30 14:53:15,949 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/b0a4a19e0db743128d33bfc59df41bdc to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/b0a4a19e0db743128d33bfc59df41bdc 2023-10-30 14:53:15,952 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/1973d79ec518447099b12199c61059ef to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/1973d79ec518447099b12199c61059ef 2023-10-30 14:53:15,953 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/0d9b95c4051e4f9183a2990d2c31fdbf to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/0d9b95c4051e4f9183a2990d2c31fdbf 2023-10-30 14:53:15,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/cf4fcb0993054d2390bb6592aeb97a86_SeqId_44_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/cf4fcb0993054d2390bb6592aeb97a86_SeqId_44_ 2023-10-30 14:53:15,963 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/4c389dde8c7a4558ac0a7f116631efa8 first=Optional[r1] last=Optional[r4] 2023-10-30 14:53:15,964 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/4c389dde8c7a4558ac0a7f116631efa8}] 2023-10-30 14:53:15,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/4c389dde8c7a4558ac0a7f116631efa8 for inclusion in 575c0b5fb7911565c72999b4af89996c/family1 2023-10-30 14:53:15,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-10-30 14:53:15,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:53:15,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:53:15,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/4c389dde8c7a4558ac0a7f116631efa8 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithMonthlyPolicy__c0q92n7bdsu0kgs3pmlioroga9p2p3i1sovtgv3qq3stase4vfh5tbpplc17gcjb/family1/4c389dde8c7a4558ac0a7f116631efa8 2023-10-30 14:53:15,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithMonthlyPolicy__c0q92n7bdsu0kgs3pmlioroga9p2p3i1sovtgv3qq3stase4vfh5tbpplc17gcjb/family1/4c389dde8c7a4558ac0a7f116631efa8 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/c740500fb7ef422599079bf90c8d2384_SeqId_47_ 2023-10-30 14:53:15,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithMonthlyPolicy__c0q92n7bdsu0kgs3pmlioroga9p2p3i1sovtgv3qq3stase4vfh5tbpplc17gcjb/family1/4c389dde8c7a4558ac0a7f116631efa8 into 575c0b5fb7911565c72999b4af89996c/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/c740500fb7ef422599079bf90c8d2384_SeqId_47_ - updating store file list. 2023-10-30 14:53:15,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/c740500fb7ef422599079bf90c8d2384_SeqId_47_ into 575c0b5fb7911565c72999b4af89996c/family1 2023-10-30 14:53:15,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithMonthlyPolicy__c0q92n7bdsu0kgs3pmlioroga9p2p3i1sovtgv3qq3stase4vfh5tbpplc17gcjb/family1/4c389dde8c7a4558ac0a7f116631efa8 into 575c0b5fb7911565c72999b4af89996c/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/c740500fb7ef422599079bf90c8d2384_SeqId_47_) 2023-10-30 14:53:15,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithMonthlyPolicy__c0q92n7bdsu0kgs3pmlioroga9p2p3i1sovtgv3qq3stase4vfh5tbpplc17gcjb/family1/4c389dde8c7a4558ac0a7f116631efa8 2023-10-30 14:53:15,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 14:53:15,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 14:53:15,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(1912): 575c0b5fb7911565c72999b4af89996c/family1 is initiating minor compaction (all files) 2023-10-30 14:53:15,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@40b3e3f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:53:15,986 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 575c0b5fb7911565c72999b4af89996c/family1 in testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:53:15,986 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/d9ac912cb1c34cdfbf18d7cd7a2f208a, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/dde677b664e74a8a90918bd9ed1c9ea1, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/c740500fb7ef422599079bf90c8d2384_SeqId_47_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp, totalSize=178.1 K 2023-10-30 14:53:15,987 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting d9ac912cb1c34cdfbf18d7cd7a2f208a, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878852219 2023-10-30 14:53:15,987 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting dde677b664e74a8a90918bd9ed1c9ea1, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621252219 2023-10-30 14:53:15,988 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting c740500fb7ef422599079bf90c8d2384_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965252219 2023-10-30 14:53:15,991 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 14:53:15,992 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:15,994 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120168942ff494b9427da4cf17bc4783499c to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120168942ff494b9427da4cf17bc4783499c 2023-10-30 14:53:15,995 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205a11ba9dafbc242f492aa3e4e1f4f7cca to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205a11ba9dafbc242f492aa3e4e1f4f7cca 2023-10-30 14:53:15,997 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512284ba347b80ebd42a29b7a51856789e3ba to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512284ba347b80ebd42a29b7a51856789e3ba 2023-10-30 14:53:15,999 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512313a04d7985e8f4d1994d2113ec65ab09d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512313a04d7985e8f4d1994d2113ec65ab09d 2023-10-30 14:53:15,999 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-10-30 14:53:15,999 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-10-30 14:53:16,000 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 14:53:16,000 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 14:53:16,029 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] throttle.PressureAwareThroughputController(145): 575c0b5fb7911565c72999b4af89996c#family1#compaction#23 average throughput is 5.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:53:16,894 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/.tmp/family1/b025790a5b924bf3bdfb20100f0b728c as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/b025790a5b924bf3bdfb20100f0b728c 2023-10-30 14:53:16,895 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ef0c90267e7141148109b24a2120760f to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ef0c90267e7141148109b24a2120760f 2023-10-30 14:53:16,896 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 14:53:16,902 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 575c0b5fb7911565c72999b4af89996c/family1 of 575c0b5fb7911565c72999b4af89996c into b025790a5b924bf3bdfb20100f0b728c(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:53:16,902 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:53:16,902 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1698677595986; duration=0sec 2023-10-30 14:53:16,903 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:53:16,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/d9ac912cb1c34cdfbf18d7cd7a2f208a, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/dde677b664e74a8a90918bd9ed1c9ea1, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/c740500fb7ef422599079bf90c8d2384_SeqId_47_] to archive 2023-10-30 14:53:16,923 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e9a878a50f774680bd14999fae87d854 first=Optional[r00] last=Optional[r8] 2023-10-30 14:53:16,923 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e9a878a50f774680bd14999fae87d854}] 2023-10-30 14:53:16,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:16,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/d9ac912cb1c34cdfbf18d7cd7a2f208a to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/d9ac912cb1c34cdfbf18d7cd7a2f208a 2023-10-30 14:53:16,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e9a878a50f774680bd14999fae87d854 for inclusion in 575c0b5fb7911565c72999b4af89996c/family1 2023-10-30 14:53:16,928 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/dde677b664e74a8a90918bd9ed1c9ea1 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/dde677b664e74a8a90918bd9ed1c9ea1 2023-10-30 14:53:16,930 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/c740500fb7ef422599079bf90c8d2384_SeqId_47_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/c740500fb7ef422599079bf90c8d2384_SeqId_47_ 2023-10-30 14:53:16,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-10-30 14:53:16,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:53:16,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:53:16,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e9a878a50f774680bd14999fae87d854 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithMonthlyPolicy__38d0i5ld1hnumhmkvg4r2ir88gi77bjgo7uns3hqiaeib26tm8n9im86j6kipdt9/family1/e9a878a50f774680bd14999fae87d854 2023-10-30 14:53:16,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithMonthlyPolicy__38d0i5ld1hnumhmkvg4r2ir88gi77bjgo7uns3hqiaeib26tm8n9im86j6kipdt9/family1/e9a878a50f774680bd14999fae87d854 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/a44ab19573014a9183a545251811edc3_SeqId_50_ 2023-10-30 14:53:16,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithMonthlyPolicy__38d0i5ld1hnumhmkvg4r2ir88gi77bjgo7uns3hqiaeib26tm8n9im86j6kipdt9/family1/e9a878a50f774680bd14999fae87d854 into 575c0b5fb7911565c72999b4af89996c/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/a44ab19573014a9183a545251811edc3_SeqId_50_ - updating store file list. 2023-10-30 14:53:16,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/a44ab19573014a9183a545251811edc3_SeqId_50_ into 575c0b5fb7911565c72999b4af89996c/family1 2023-10-30 14:53:16,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithMonthlyPolicy__38d0i5ld1hnumhmkvg4r2ir88gi77bjgo7uns3hqiaeib26tm8n9im86j6kipdt9/family1/e9a878a50f774680bd14999fae87d854 into 575c0b5fb7911565c72999b4af89996c/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/family1/a44ab19573014a9183a545251811edc3_SeqId_50_) 2023-10-30 14:53:16,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithMonthlyPolicy__38d0i5ld1hnumhmkvg4r2ir88gi77bjgo7uns3hqiaeib26tm8n9im86j6kipdt9/family1/e9a878a50f774680bd14999fae87d854 2023-10-30 14:53:16,943 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 14:53:16,944 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:16,946 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112006ecf3c616374265a5e2fcad3b710810 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112006ecf3c616374265a5e2fcad3b710810 2023-10-30 14:53:16,947 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128d35a02665151413190c521aaf6b22626 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128d35a02665151413190c521aaf6b22626 2023-10-30 14:53:16,948 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113076a2c280144747df980853af2c7f445a to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113076a2c280144747df980853af2c7f445a 2023-10-30 14:53:16,948 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-10-30 14:53:16,948 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-30 14:53:16,948 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 14:53:16,948 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 14:53:16,948 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 14:53:16,948 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 14:53:16,948 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:53:16,950 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 14:53:16,951 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.7980 sec 2023-10-30 14:53:17,060 INFO [Listener at localhost/34621] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=254 (was 254), OpenFileDescriptor=613 (was 601) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=391 (was 320) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 169), AvailableMemoryMB=2223 (was 2455) 2023-10-30 14:53:17,071 INFO [Listener at localhost/34621] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=254, OpenFileDescriptor=613, MaxFileDescriptor=60000, SystemLoadAverage=391, ProcessCount=168, AvailableMemoryMB=2222 2023-10-30 14:53:17,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 14:53:17,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:17,077 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 14:53:17,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-10-30 14:53:17,078 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 14:53:17,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-30 14:53:17,080 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767 2023-10-30 14:53:17,080 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767 empty. 2023-10-30 14:53:17,081 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767 2023-10-30 14:53:17,081 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-10-30 14:53:17,092 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-30 14:53:17,093 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 152dd2029edf29e5f98fc7ec046f7767, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:53:17,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-30 14:53:17,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-30 14:53:17,501 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:53:17,501 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 152dd2029edf29e5f98fc7ec046f7767, disabling compactions & flushes 2023-10-30 14:53:17,501 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:17,501 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:17,502 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. after waiting 1 ms 2023-10-30 14:53:17,502 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:17,502 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:17,502 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 152dd2029edf29e5f98fc7ec046f7767: 2023-10-30 14:53:17,507 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 14:53:17,510 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698677597509"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677597509"}]},"ts":"1698677597509"} 2023-10-30 14:53:17,512 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 14:53:17,513 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 14:53:17,513 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677597513"}]},"ts":"1698677597513"} 2023-10-30 14:53:17,515 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-10-30 14:53:17,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=152dd2029edf29e5f98fc7ec046f7767, ASSIGN}] 2023-10-30 14:53:17,521 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=152dd2029edf29e5f98fc7ec046f7767, ASSIGN 2023-10-30 14:53:17,522 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=152dd2029edf29e5f98fc7ec046f7767, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:53:17,673 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=152dd2029edf29e5f98fc7ec046f7767, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:17,674 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698677597673"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677597673"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677597673"}]},"ts":"1698677597673"} 2023-10-30 14:53:17,677 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 152dd2029edf29e5f98fc7ec046f7767, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:53:17,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-30 14:53:17,831 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:17,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:17,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 152dd2029edf29e5f98fc7ec046f7767, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767.', STARTKEY => '', ENDKEY => ''} 2023-10-30 14:53:17,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 152dd2029edf29e5f98fc7ec046f7767 2023-10-30 14:53:17,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:53:17,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 152dd2029edf29e5f98fc7ec046f7767 2023-10-30 14:53:17,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 152dd2029edf29e5f98fc7ec046f7767 2023-10-30 14:53:17,841 INFO [StoreOpener-152dd2029edf29e5f98fc7ec046f7767-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 152dd2029edf29e5f98fc7ec046f7767 2023-10-30 14:53:17,845 DEBUG [StoreOpener-152dd2029edf29e5f98fc7ec046f7767-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1 2023-10-30 14:53:17,845 DEBUG [StoreOpener-152dd2029edf29e5f98fc7ec046f7767-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1 2023-10-30 14:53:17,846 INFO [StoreOpener-152dd2029edf29e5f98fc7ec046f7767-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 152dd2029edf29e5f98fc7ec046f7767 columnFamilyName family1 2023-10-30 14:53:17,849 INFO [StoreOpener-152dd2029edf29e5f98fc7ec046f7767-1] regionserver.HStore(310): Store=152dd2029edf29e5f98fc7ec046f7767/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:53:17,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767 2023-10-30 14:53:17,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767 2023-10-30 14:53:17,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 152dd2029edf29e5f98fc7ec046f7767 2023-10-30 14:53:17,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:53:17,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 152dd2029edf29e5f98fc7ec046f7767; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63291657, jitterRate=-0.05688081681728363}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 14:53:17,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 152dd2029edf29e5f98fc7ec046f7767: 2023-10-30 14:53:17,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767., pid=25, masterSystemTime=1698677597831 2023-10-30 14:53:17,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:17,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:17,865 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=152dd2029edf29e5f98fc7ec046f7767, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:17,865 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698677597865"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677597865"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677597865"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677597865"}]},"ts":"1698677597865"} 2023-10-30 14:53:17,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-10-30 14:53:17,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 152dd2029edf29e5f98fc7ec046f7767, server=jenkins-hbase20.apache.org,36359,1698677568317 in 189 msec 2023-10-30 14:53:17,871 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-10-30 14:53:17,871 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=152dd2029edf29e5f98fc7ec046f7767, ASSIGN in 350 msec 2023-10-30 14:53:17,871 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 14:53:17,872 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677597871"}]},"ts":"1698677597871"} 2023-10-30 14:53:17,873 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-10-30 14:53:17,876 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 14:53:17,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 803 msec 2023-10-30 14:53:18,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-30 14:53:18,187 INFO [Listener at localhost/34621] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-10-30 14:53:18,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:18,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:18,217 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:18,217 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:18,217 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:18,217 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:18,217 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:18,217 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:18,218 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:18,218 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:18,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:18,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:18,219 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:18,219 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:18,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:18,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:18,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:18,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:18,220 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:18,220 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:18,220 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:18,220 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:18,220 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:18,220 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:18,220 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:18,220 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:18,220 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. started... 2023-10-30 14:53:18,221 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 152dd2029edf29e5f98fc7ec046f7767 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 14:53:18,653 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303633ad53ea5a41319dcd5da618ed9021 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511303633ad53ea5a41319dcd5da618ed9021 2023-10-30 14:53:19,060 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/a99ad36d3029469583b300a70ec8d5ff 2023-10-30 14:53:19,072 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/a99ad36d3029469583b300a70ec8d5ff as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/a99ad36d3029469583b300a70ec8d5ff 2023-10-30 14:53:19,079 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/a99ad36d3029469583b300a70ec8d5ff, entries=1000, sequenceid=5, filesize=165.1 K 2023-10-30 14:53:19,080 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 152dd2029edf29e5f98fc7ec046f7767 in 859ms, sequenceid=5, compaction requested=false 2023-10-30 14:53:19,080 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:19,081 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 152dd2029edf29e5f98fc7ec046f7767: 2023-10-30 14:53:19,081 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:19,081 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:19,081 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:19,081 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:19,081 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:19,081 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:19,083 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:19,083 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:19,084 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:19,084 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:19,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:19,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:19,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:19,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:19,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e13d487[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:19,086 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:19,086 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,087 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,087 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:19,087 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:19,087 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:19,088 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:19,088 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:19,089 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:19,089 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:19,089 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:19,089 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:19,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:19,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:19,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:19,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:19,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:19,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:19,093 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:19,093 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:19,093 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:19,093 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,093 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:19,094 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,094 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,094 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:19,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:19,095 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:19,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,097 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:19,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:19,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:19,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:19,101 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:19,101 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,101 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,101 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:19,101 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:19,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:19,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:19,101 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,102 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,102 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 14:53:19,101 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:19,102 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:19,102 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:19,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:19,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:19,102 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:19,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:19,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:19,203 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:19,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:19,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:19,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:19,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,216 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:19,216 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:19,216 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:19,216 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:19,216 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,216 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,217 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:19,217 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:19,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:19,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:19,218 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:19,218 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:19,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:19,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,218 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,218 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:19,218 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:19,218 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:19,219 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:19,219 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:19,219 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:19,219 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:19,219 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:19,219 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. started... 2023-10-30 14:53:19,219 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 152dd2029edf29e5f98fc7ec046f7767 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 14:53:19,642 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112871c8f013a8c448b5a2f253d26a438baa to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015112871c8f013a8c448b5a2f253d26a438baa 2023-10-30 14:53:20,051 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/f3b0c4ccbce248239ba5865fcd1dc297 2023-10-30 14:53:20,064 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/f3b0c4ccbce248239ba5865fcd1dc297 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/f3b0c4ccbce248239ba5865fcd1dc297 2023-10-30 14:53:20,072 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/f3b0c4ccbce248239ba5865fcd1dc297, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 14:53:20,073 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 152dd2029edf29e5f98fc7ec046f7767 in 854ms, sequenceid=9, compaction requested=false 2023-10-30 14:53:20,073 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 152dd2029edf29e5f98fc7ec046f7767: 2023-10-30 14:53:20,073 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:20,073 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:20,074 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:20,074 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:20,074 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:20,074 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:20,075 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:20,075 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:20,075 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,075 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:20,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:20,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:20,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2edeeed7[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:20,077 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:20,077 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,077 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,078 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:20,078 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:20,078 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:20,078 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:20,078 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:20,079 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:20,079 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:20,079 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:20,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:20,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:20,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:20,079 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:20,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:20,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:20,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:20,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:20,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:20,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:20,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:20,081 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:20,081 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:20,081 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:20,081 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,081 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:20,082 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,082 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:20,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:20,082 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:20,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:20,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:20,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:20,083 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:20,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:20,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,084 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:20,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:20,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:20,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:20,086 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:20,086 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,086 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:20,086 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 14:53:20,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:20,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:20,086 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:20,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:20,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:20,086 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:20,087 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:20,086 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:20,087 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:20,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:20,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:20,087 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,087 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,087 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,187 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:20,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:20,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:20,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:20,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,202 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:20,202 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:20,202 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:20,203 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:20,203 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,203 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,204 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:20,204 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:20,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:20,204 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:20,204 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,205 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,206 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:20,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:20,206 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:20,206 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:20,206 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:20,206 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:20,206 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:20,206 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:20,206 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. started... 2023-10-30 14:53:20,206 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 152dd2029edf29e5f98fc7ec046f7767 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:20,625 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512011c21abfa712346bc80b1eab11f9f73ba to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512011c21abfa712346bc80b1eab11f9f73ba 2023-10-30 14:53:21,034 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/ecce861ea3c0401d9fbc82244c2a2699 2023-10-30 14:53:21,049 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/ecce861ea3c0401d9fbc82244c2a2699 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/ecce861ea3c0401d9fbc82244c2a2699 2023-10-30 14:53:21,056 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/ecce861ea3c0401d9fbc82244c2a2699, entries=1, sequenceid=13, filesize=4.9 K 2023-10-30 14:53:21,057 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 152dd2029edf29e5f98fc7ec046f7767 in 851ms, sequenceid=13, compaction requested=true 2023-10-30 14:53:21,057 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 152dd2029edf29e5f98fc7ec046f7767: 2023-10-30 14:53:21,057 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:21,058 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:21,058 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:21,058 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:21,058 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:21,058 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:21,059 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,059 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:21,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:21,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:21,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:21,060 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,060 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:21,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:21,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:21,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:21,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:21,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:21,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44aa9db7[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:21,062 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:21,062 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,063 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,063 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:21,064 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:21,064 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:21,064 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:21,064 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:21,065 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:21,065 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:21,065 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:21,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:21,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:21,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:21,065 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:21,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:21,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:21,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:21,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:21,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:21,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:21,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:21,069 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:21,069 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:21,069 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:21,069 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,069 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:21,071 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,071 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:21,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:21,071 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:21,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:21,071 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:21,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:21,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:21,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:21,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,072 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:21,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:21,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:21,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:21,074 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:21,074 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,074 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:21,074 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,075 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:21,075 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 14:53:21,075 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:21,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:21,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:21,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:21,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:21,075 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:21,075 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,075 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,075 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,075 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:21,075 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:21,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:21,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:21,175 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:21,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:21,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:21,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:21,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,192 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:21,192 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:21,192 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:21,192 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:21,193 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,193 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,194 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:21,194 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:21,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:21,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:21,194 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:21,194 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:21,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:21,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,195 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,195 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:21,196 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:21,196 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:21,196 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:21,196 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:21,196 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:21,196 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:21,196 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:21,196 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. started... 2023-10-30 14:53:21,196 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 152dd2029edf29e5f98fc7ec046f7767 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:21,618 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ad476860b9624ff6a00f38cd75a1e1cf to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ad476860b9624ff6a00f38cd75a1e1cf 2023-10-30 14:53:22,026 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/6b0ec87947944197ae7d34dafc527fc9 2023-10-30 14:53:22,037 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/6b0ec87947944197ae7d34dafc527fc9 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/6b0ec87947944197ae7d34dafc527fc9 2023-10-30 14:53:22,046 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/6b0ec87947944197ae7d34dafc527fc9, entries=1, sequenceid=17, filesize=4.9 K 2023-10-30 14:53:22,047 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 152dd2029edf29e5f98fc7ec046f7767 in 851ms, sequenceid=17, compaction requested=true 2023-10-30 14:53:22,048 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 152dd2029edf29e5f98fc7ec046f7767: 2023-10-30 14:53:22,048 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:22,048 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:22,048 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:22,048 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,048 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:22,048 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:22,050 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,050 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:22,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:22,050 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,050 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:22,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:22,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:22,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:22,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:22,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d3f69d2[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:22,052 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:22,052 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,053 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,053 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:22,053 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:22,053 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:22,053 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,053 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:22,054 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,054 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:22,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:22,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:22,054 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:22,054 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:22,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:22,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:22,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:22,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:22,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:22,056 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:22,056 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:22,056 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:22,056 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,056 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:22,057 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,057 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:22,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:22,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,057 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:22,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:22,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:22,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:22,058 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:22,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,059 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:22,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,060 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,060 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:22,060 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:22,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:22,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:22,060 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:22,060 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,060 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:22,061 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:22,061 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,061 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:22,061 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,061 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:22,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:22,061 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:22,161 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:22,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:22,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:22,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:22,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,169 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:22,169 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:22,169 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:22,169 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:22,170 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,170 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,171 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,171 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:22,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:22,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:22,171 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,171 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:22,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:22,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,172 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,172 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:22,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,172 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:22,173 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:22,173 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:22,173 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:22,173 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:22,173 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:22,173 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. started... 2023-10-30 14:53:22,173 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 152dd2029edf29e5f98fc7ec046f7767 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:22,190 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512282dfce6d8cab54e5d820fd440ef626d1d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512282dfce6d8cab54e5d820fd440ef626d1d 2023-10-30 14:53:22,600 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/b257a131f65942768c0a49de199da7da 2023-10-30 14:53:22,614 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/b257a131f65942768c0a49de199da7da as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/b257a131f65942768c0a49de199da7da 2023-10-30 14:53:22,623 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/b257a131f65942768c0a49de199da7da, entries=1, sequenceid=21, filesize=4.9 K 2023-10-30 14:53:22,624 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 152dd2029edf29e5f98fc7ec046f7767 in 451ms, sequenceid=21, compaction requested=true 2023-10-30 14:53:22,624 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 152dd2029edf29e5f98fc7ec046f7767: 2023-10-30 14:53:22,624 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:22,624 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:22,624 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:22,624 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,625 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:22,625 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:22,626 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,626 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:22,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:22,627 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,627 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:22,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:22,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:22,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:22,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:22,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d58231e[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:22,629 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:22,630 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,630 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,631 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:22,631 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:22,631 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:22,631 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,631 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:22,632 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,632 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:22,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:22,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:22,632 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:22,632 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:22,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:22,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:22,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:22,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:22,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:22,634 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:22,634 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:22,634 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:22,634 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,634 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:22,635 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,635 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:22,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:22,635 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:22,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:22,636 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:22,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:22,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:22,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,637 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:22,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,638 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,638 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,638 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:22,638 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:22,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:22,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:22,638 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:22,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:22,638 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:22,639 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,639 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,639 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:22,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:22,639 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:22,639 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:22,639 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,739 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:22,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:22,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:22,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:22,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,756 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:22,756 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:22,756 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:22,756 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:22,756 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,756 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,757 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:22,757 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:22,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:22,758 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:22,758 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:22,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,758 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:22,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,758 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,759 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:22,759 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:22,759 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:22,759 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:22,759 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:22,759 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:22,759 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:22,759 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:22,759 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. started... 2023-10-30 14:53:22,759 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 152dd2029edf29e5f98fc7ec046f7767 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:23,182 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318da4a902cf0244eebd85a83e4807f242 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512318da4a902cf0244eebd85a83e4807f242 2023-10-30 14:53:23,372 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 14:53:23,592 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/3e64501786324c9ca349443e83af3e6f 2023-10-30 14:53:23,604 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/3e64501786324c9ca349443e83af3e6f as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/3e64501786324c9ca349443e83af3e6f 2023-10-30 14:53:23,613 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/3e64501786324c9ca349443e83af3e6f, entries=1, sequenceid=25, filesize=4.9 K 2023-10-30 14:53:23,614 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 152dd2029edf29e5f98fc7ec046f7767 in 855ms, sequenceid=25, compaction requested=true 2023-10-30 14:53:23,614 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 152dd2029edf29e5f98fc7ec046f7767: 2023-10-30 14:53:23,614 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:23,614 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:23,614 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:23,615 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:23,615 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:23,615 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:23,616 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,616 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:23,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:23,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:23,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:23,617 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,617 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:23,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:23,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:23,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:23,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:23,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:23,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a9d634[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:23,620 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:23,620 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,624 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,624 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:23,624 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:23,624 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:23,624 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:23,624 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:23,626 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:23,626 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:23,626 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:23,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:23,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:23,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:23,626 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:23,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:23,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:23,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:23,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:23,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:23,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:23,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:23,630 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:23,630 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:23,630 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:23,630 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,630 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:23,632 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,632 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:23,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:23,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,632 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:23,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:23,633 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:23,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:23,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:23,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:23,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:23,635 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:23,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:23,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:23,639 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:23,639 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:23,639 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:23,639 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:23,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:23,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:23,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:23,639 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:23,639 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,640 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:23,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:23,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:23,640 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,640 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:23,640 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:23,640 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,640 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,740 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:23,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:23,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:23,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:23,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,755 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:23,755 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:23,755 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:23,755 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:23,756 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,756 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,757 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:23,757 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:23,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:23,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:23,757 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:23,758 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:23,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,758 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:23,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,759 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,760 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:23,760 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:23,760 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:23,760 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:23,760 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:23,760 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:23,760 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:23,760 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:23,761 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. started... 2023-10-30 14:53:23,761 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 152dd2029edf29e5f98fc7ec046f7767 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:24,186 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010134ba7710ba154ba1aa9b2db6a95fef90 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010134ba7710ba154ba1aa9b2db6a95fef90 2023-10-30 14:53:24,595 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/74b8fe89a2c749d38adce07b0abe316e 2023-10-30 14:53:24,607 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/74b8fe89a2c749d38adce07b0abe316e as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/74b8fe89a2c749d38adce07b0abe316e 2023-10-30 14:53:24,616 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/74b8fe89a2c749d38adce07b0abe316e, entries=1, sequenceid=29, filesize=4.9 K 2023-10-30 14:53:24,617 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 152dd2029edf29e5f98fc7ec046f7767 in 856ms, sequenceid=29, compaction requested=true 2023-10-30 14:53:24,618 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 152dd2029edf29e5f98fc7ec046f7767: 2023-10-30 14:53:24,618 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:24,618 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:24,618 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:24,618 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:24,618 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:24,618 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:24,620 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:24,620 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:24,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:24,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:24,621 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,621 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:24,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:24,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:24,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:24,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:24,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:24,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14feb433[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:24,623 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:24,624 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,625 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,625 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:24,625 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:24,625 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:24,625 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:24,625 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:24,627 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:24,627 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:24,627 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:24,627 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:24,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:24,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:24,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:24,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:24,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:24,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:24,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:24,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:24,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:24,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:24,630 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:24,631 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:24,631 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:24,631 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,631 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:24,633 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,633 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:24,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,633 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:24,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:24,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:24,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:24,634 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:24,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:24,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:24,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,636 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:24,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:24,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:24,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:24,643 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:24,643 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,643 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:24,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:24,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:24,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:24,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:24,643 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:24,643 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 14:53:24,643 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:24,643 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,644 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:24,644 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:24,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:24,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:24,644 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:24,645 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,645 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,645 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,744 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:24,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:24,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:24,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:24,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,760 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:24,760 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:24,760 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:24,760 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:24,761 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,761 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,762 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:24,762 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:24,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:24,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:24,762 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:24,763 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:24,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:24,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,764 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,764 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:24,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:24,765 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:24,765 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:24,765 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:24,765 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:24,765 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:24,765 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:24,765 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. started... 2023-10-30 14:53:24,765 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 152dd2029edf29e5f98fc7ec046f7767 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:25,192 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103770d258faec34cac8ea787f2b8be4acb to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103770d258faec34cac8ea787f2b8be4acb 2023-10-30 14:53:25,599 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/c2ed2f08cbe34ef69c1396464385d220 2023-10-30 14:53:25,614 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/c2ed2f08cbe34ef69c1396464385d220 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/c2ed2f08cbe34ef69c1396464385d220 2023-10-30 14:53:25,625 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/c2ed2f08cbe34ef69c1396464385d220, entries=1, sequenceid=33, filesize=4.9 K 2023-10-30 14:53:25,626 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 152dd2029edf29e5f98fc7ec046f7767 in 861ms, sequenceid=33, compaction requested=true 2023-10-30 14:53:25,626 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 152dd2029edf29e5f98fc7ec046f7767: 2023-10-30 14:53:25,626 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:25,626 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:25,626 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:25,626 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:25,626 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:25,626 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:25,628 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,628 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:25,628 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,629 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:25,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:25,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:25,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:25,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:25,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:25,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62f93e87[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:25,631 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:25,631 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,632 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,632 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:25,632 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:25,632 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:25,632 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:25,632 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:25,633 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:25,634 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:25,634 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:25,634 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:25,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:25,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:25,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:25,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:25,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:25,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:25,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:25,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:25,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:25,638 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:25,638 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:25,638 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:25,639 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,639 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:25,640 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,640 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:25,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:25,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,641 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:25,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:25,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:25,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:25,641 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:25,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:25,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:25,643 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:25,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:25,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:25,649 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:25,649 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:25,649 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:25,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:25,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 14:53:25,649 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:25,649 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:25,649 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:25,649 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:25,650 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:25,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:25,649 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:25,650 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,650 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,650 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:25,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:25,750 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:25,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:25,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:25,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:25,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,765 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:25,765 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:25,765 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:25,765 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:25,766 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,766 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,767 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:25,767 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:25,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:25,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:25,768 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:25,768 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:25,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:25,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,769 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,769 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:25,769 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:25,769 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:25,769 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:25,769 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:25,770 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:25,770 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:25,770 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:25,770 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. started... 2023-10-30 14:53:25,770 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 152dd2029edf29e5f98fc7ec046f7767 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:26,192 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907b7cb9f94a4b94548b065cad23062f3b3 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907b7cb9f94a4b94548b065cad23062f3b3 2023-10-30 14:53:26,600 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/3ae3d135c38c4deca8108fac1dd4ee98 2023-10-30 14:53:26,606 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/3ae3d135c38c4deca8108fac1dd4ee98 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/3ae3d135c38c4deca8108fac1dd4ee98 2023-10-30 14:53:26,611 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/3ae3d135c38c4deca8108fac1dd4ee98, entries=1, sequenceid=37, filesize=4.9 K 2023-10-30 14:53:26,612 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 152dd2029edf29e5f98fc7ec046f7767 in 842ms, sequenceid=37, compaction requested=true 2023-10-30 14:53:26,613 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 152dd2029edf29e5f98fc7ec046f7767: 2023-10-30 14:53:26,613 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:26,613 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:26,613 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:26,613 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:26,613 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:26,613 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:26,614 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:26,614 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:26,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:26,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:26,615 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,615 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:26,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:26,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:26,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:26,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:26,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:26,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e25a115[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:26,616 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:26,616 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,618 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,618 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:26,618 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:26,618 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:26,618 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:26,618 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:26,619 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:26,619 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:26,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:26,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:26,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:26,619 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:26,619 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:26,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:26,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:26,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:26,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:26,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:26,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:26,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:26,621 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:26,621 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:26,621 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:26,621 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,621 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:26,623 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,623 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,623 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:26,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:26,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:26,623 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:26,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:26,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:26,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:26,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:26,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,624 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:26,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:26,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:26,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:26,626 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:26,626 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,626 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:26,626 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:26,626 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:26,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:26,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:26,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:26,626 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:26,626 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:26,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 14:53:26,626 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:26,626 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,626 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:26,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:26,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:26,626 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,627 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,727 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:26,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:26,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:26,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:26,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,733 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:26,733 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:26,733 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:26,733 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:26,734 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,734 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,735 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:26,735 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:26,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:26,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:26,735 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:26,735 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:26,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:26,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,736 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,736 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:26,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:26,736 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:26,736 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:26,736 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:26,738 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:26,738 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:26,738 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:26,738 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. started... 2023-10-30 14:53:26,739 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 152dd2029edf29e5f98fc7ec046f7767 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:27,154 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511201af5f8afed454b719129a19748599e97 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511201af5f8afed454b719129a19748599e97 2023-10-30 14:53:27,162 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/9a67f13da70f43ea89e654c9a2c95cb9 2023-10-30 14:53:27,170 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/9a67f13da70f43ea89e654c9a2c95cb9 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/9a67f13da70f43ea89e654c9a2c95cb9 2023-10-30 14:53:27,176 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/9a67f13da70f43ea89e654c9a2c95cb9, entries=1, sequenceid=41, filesize=4.9 K 2023-10-30 14:53:27,177 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 152dd2029edf29e5f98fc7ec046f7767 in 438ms, sequenceid=41, compaction requested=true 2023-10-30 14:53:27,177 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 152dd2029edf29e5f98fc7ec046f7767: 2023-10-30 14:53:27,177 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:27,177 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:27,177 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:27,177 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:27,177 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:27,177 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:27,178 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:27,178 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:27,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:27,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:27,179 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,179 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:27,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:27,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:27,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:27,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:27,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:27,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3477d093[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:27,180 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:27,180 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,181 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,181 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:27,181 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:27,181 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:27,181 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:27,181 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:27,182 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:27,182 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:27,182 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:27,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:27,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:27,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:27,182 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:27,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:27,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:27,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:27,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:27,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:27,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:27,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:27,185 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:27,185 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:27,185 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:27,185 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,185 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:27,186 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,186 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:27,186 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:27,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:27,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:27,186 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:27,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:27,187 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:27,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:27,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:27,188 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:27,188 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,188 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:27,188 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,188 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:27,188 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:27,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 14:53:27,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:27,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:27,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:27,188 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:27,188 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,189 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,189 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:27,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:27,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:27,189 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,189 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:27,289 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:27,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:27,294 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43911] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-10-30 14:53:27,298 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 14:53:27,299 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 14:53:27,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:53:27,300 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698678207300 2023-10-30 14:53:27,301 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 14:53:27,303 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-10-30 14:53:27,304 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 14:53:27,306 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] zookeeper.ReadOnlyZKClient(139): Connect 0x43c0c6f9 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:53:27,310 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51f39fa5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:53:27,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:28,167 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010362e17795a2d147eab262986142374015 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010362e17795a2d147eab262986142374015 2023-10-30 14:53:28,170 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 14:53:28,182 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:53:28,183 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:53:28,191 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 14:53:28,193 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 14:53:28,205 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b2f060d9cb6b430e853a3737f00f85d9 first=Optional[r3] last=Optional[r6] 2023-10-30 14:53:28,206 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b2f060d9cb6b430e853a3737f00f85d9}] 2023-10-30 14:53:28,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b2f060d9cb6b430e853a3737f00f85d9 for inclusion in 152dd2029edf29e5f98fc7ec046f7767/family1 2023-10-30 14:53:28,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-30 14:53:28,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:53:28,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 152dd2029edf29e5f98fc7ec046f7767: 2023-10-30 14:53:28,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b2f060d9cb6b430e853a3737f00f85d9 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f0c905rk421s0lj416h63qltfiu0rn2a88ep4qpcbgfpljrb23oobkhpup51g748/family1/b2f060d9cb6b430e853a3737f00f85d9 2023-10-30 14:53:28,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f0c905rk421s0lj416h63qltfiu0rn2a88ep4qpcbgfpljrb23oobkhpup51g748/family1/b2f060d9cb6b430e853a3737f00f85d9 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/d0ca4c1874db4d5cb8657551c77bf11e_SeqId_44_ 2023-10-30 14:53:28,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f0c905rk421s0lj416h63qltfiu0rn2a88ep4qpcbgfpljrb23oobkhpup51g748/family1/b2f060d9cb6b430e853a3737f00f85d9 into 152dd2029edf29e5f98fc7ec046f7767/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/d0ca4c1874db4d5cb8657551c77bf11e_SeqId_44_ - updating store file list. 2023-10-30 14:53:28,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/d0ca4c1874db4d5cb8657551c77bf11e_SeqId_44_ into 152dd2029edf29e5f98fc7ec046f7767/family1 2023-10-30 14:53:28,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f0c905rk421s0lj416h63qltfiu0rn2a88ep4qpcbgfpljrb23oobkhpup51g748/family1/b2f060d9cb6b430e853a3737f00f85d9 into 152dd2029edf29e5f98fc7ec046f7767/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/d0ca4c1874db4d5cb8657551c77bf11e_SeqId_44_) 2023-10-30 14:53:28,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f0c905rk421s0lj416h63qltfiu0rn2a88ep4qpcbgfpljrb23oobkhpup51g748/family1/b2f060d9cb6b430e853a3737f00f85d9 2023-10-30 14:53:28,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 14:53:28,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 14:53:28,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(1912): 152dd2029edf29e5f98fc7ec046f7767/family1 is initiating minor compaction 2023-10-30 14:53:28,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@bed7ecb; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:53:28,225 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 152dd2029edf29e5f98fc7ec046f7767/family1 in testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:28,225 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/f3b0c4ccbce248239ba5865fcd1dc297, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/ecce861ea3c0401d9fbc82244c2a2699, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/6b0ec87947944197ae7d34dafc527fc9, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/b257a131f65942768c0a49de199da7da, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/3e64501786324c9ca349443e83af3e6f, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/74b8fe89a2c749d38adce07b0abe316e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/c2ed2f08cbe34ef69c1396464385d220, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/3ae3d135c38c4deca8108fac1dd4ee98, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/9a67f13da70f43ea89e654c9a2c95cb9, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/d0ca4c1874db4d5cb8657551c77bf11e_SeqId_44_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp, totalSize=50.0 K 2023-10-30 14:53:28,225 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting f3b0c4ccbce248239ba5865fcd1dc297, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 14:53:28,225 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting ecce861ea3c0401d9fbc82244c2a2699, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 14:53:28,225 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting 6b0ec87947944197ae7d34dafc527fc9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 14:53:28,225 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting b257a131f65942768c0a49de199da7da, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 14:53:28,225 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting 3e64501786324c9ca349443e83af3e6f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 14:53:28,226 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting 74b8fe89a2c749d38adce07b0abe316e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 14:53:28,226 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting c2ed2f08cbe34ef69c1396464385d220, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 14:53:28,226 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting 3ae3d135c38c4deca8108fac1dd4ee98, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 14:53:28,226 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting 9a67f13da70f43ea89e654c9a2c95cb9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 14:53:28,226 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting d0ca4c1874db4d5cb8657551c77bf11e_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 14:53:28,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 14:53:28,228 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:28,230 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512282dfce6d8cab54e5d820fd440ef626d1d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512282dfce6d8cab54e5d820fd440ef626d1d 2023-10-30 14:53:28,231 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512318da4a902cf0244eebd85a83e4807f242 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512318da4a902cf0244eebd85a83e4807f242 2023-10-30 14:53:28,233 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010134ba7710ba154ba1aa9b2db6a95fef90 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010134ba7710ba154ba1aa9b2db6a95fef90 2023-10-30 14:53:28,234 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103770d258faec34cac8ea787f2b8be4acb to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103770d258faec34cac8ea787f2b8be4acb 2023-10-30 14:53:28,234 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-10-30 14:53:28,234 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-30 14:53:28,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:28,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:28,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:28,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:28,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:28,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:28,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:28,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:28,262 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] throttle.PressureAwareThroughputController(145): 152dd2029edf29e5f98fc7ec046f7767#family1#compaction#34 average throughput is 1.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:53:29,084 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b307451c9a044eb8a0ae8fa7879bcd67 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205b307451c9a044eb8a0ae8fa7879bcd67 2023-10-30 14:53:29,086 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 14:53:29,089 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/f23a31c3733c497f838d068a8aad632b as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/f23a31c3733c497f838d068a8aad632b 2023-10-30 14:53:29,098 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 152dd2029edf29e5f98fc7ec046f7767/family1 of 152dd2029edf29e5f98fc7ec046f7767 into f23a31c3733c497f838d068a8aad632b(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:53:29,098 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 152dd2029edf29e5f98fc7ec046f7767: 2023-10-30 14:53:29,098 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698677608225; duration=0sec 2023-10-30 14:53:29,098 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:53:29,118 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/52c18d2e74ef4517aa37ba1a152ff45e first=Optional[r1] last=Optional[r2] 2023-10-30 14:53:29,118 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/52c18d2e74ef4517aa37ba1a152ff45e}] 2023-10-30 14:53:29,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/52c18d2e74ef4517aa37ba1a152ff45e for inclusion in 152dd2029edf29e5f98fc7ec046f7767/family1 2023-10-30 14:53:29,131 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/f3b0c4ccbce248239ba5865fcd1dc297, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/ecce861ea3c0401d9fbc82244c2a2699, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/6b0ec87947944197ae7d34dafc527fc9, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/b257a131f65942768c0a49de199da7da, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/3e64501786324c9ca349443e83af3e6f, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/74b8fe89a2c749d38adce07b0abe316e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/c2ed2f08cbe34ef69c1396464385d220, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/3ae3d135c38c4deca8108fac1dd4ee98, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/9a67f13da70f43ea89e654c9a2c95cb9, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/d0ca4c1874db4d5cb8657551c77bf11e_SeqId_44_] to archive 2023-10-30 14:53:29,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:29,133 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/f3b0c4ccbce248239ba5865fcd1dc297 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/f3b0c4ccbce248239ba5865fcd1dc297 2023-10-30 14:53:29,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-10-30 14:53:29,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:53:29,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 152dd2029edf29e5f98fc7ec046f7767: 2023-10-30 14:53:29,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/ecce861ea3c0401d9fbc82244c2a2699 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/ecce861ea3c0401d9fbc82244c2a2699 2023-10-30 14:53:29,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/52c18d2e74ef4517aa37ba1a152ff45e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ciqv2eshujerjko9di4no28p52qni8iho2lh77e9uch5at8qjl643t0ov4opaoet/family1/52c18d2e74ef4517aa37ba1a152ff45e 2023-10-30 14:53:29,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/6b0ec87947944197ae7d34dafc527fc9 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/6b0ec87947944197ae7d34dafc527fc9 2023-10-30 14:53:29,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ciqv2eshujerjko9di4no28p52qni8iho2lh77e9uch5at8qjl643t0ov4opaoet/family1/52c18d2e74ef4517aa37ba1a152ff45e as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/4d4f30c8b70940e98f46aa25e560d9b4_SeqId_47_ 2023-10-30 14:53:29,138 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/b257a131f65942768c0a49de199da7da to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/b257a131f65942768c0a49de199da7da 2023-10-30 14:53:29,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ciqv2eshujerjko9di4no28p52qni8iho2lh77e9uch5at8qjl643t0ov4opaoet/family1/52c18d2e74ef4517aa37ba1a152ff45e into 152dd2029edf29e5f98fc7ec046f7767/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/4d4f30c8b70940e98f46aa25e560d9b4_SeqId_47_ - updating store file list. 2023-10-30 14:53:29,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/3e64501786324c9ca349443e83af3e6f to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/3e64501786324c9ca349443e83af3e6f 2023-10-30 14:53:29,140 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/74b8fe89a2c749d38adce07b0abe316e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/74b8fe89a2c749d38adce07b0abe316e 2023-10-30 14:53:29,142 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/c2ed2f08cbe34ef69c1396464385d220 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/c2ed2f08cbe34ef69c1396464385d220 2023-10-30 14:53:29,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/4d4f30c8b70940e98f46aa25e560d9b4_SeqId_47_ into 152dd2029edf29e5f98fc7ec046f7767/family1 2023-10-30 14:53:29,144 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/3ae3d135c38c4deca8108fac1dd4ee98 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/3ae3d135c38c4deca8108fac1dd4ee98 2023-10-30 14:53:29,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ciqv2eshujerjko9di4no28p52qni8iho2lh77e9uch5at8qjl643t0ov4opaoet/family1/52c18d2e74ef4517aa37ba1a152ff45e into 152dd2029edf29e5f98fc7ec046f7767/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/4d4f30c8b70940e98f46aa25e560d9b4_SeqId_47_) 2023-10-30 14:53:29,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ciqv2eshujerjko9di4no28p52qni8iho2lh77e9uch5at8qjl643t0ov4opaoet/family1/52c18d2e74ef4517aa37ba1a152ff45e 2023-10-30 14:53:29,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 14:53:29,145 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/9a67f13da70f43ea89e654c9a2c95cb9 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/9a67f13da70f43ea89e654c9a2c95cb9 2023-10-30 14:53:29,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 14:53:29,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(1912): 152dd2029edf29e5f98fc7ec046f7767/family1 is initiating minor compaction (all files) 2023-10-30 14:53:29,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@778772ad; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:53:29,146 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 152dd2029edf29e5f98fc7ec046f7767/family1 in testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:53:29,146 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/a99ad36d3029469583b300a70ec8d5ff, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/f23a31c3733c497f838d068a8aad632b, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/4d4f30c8b70940e98f46aa25e560d9b4_SeqId_47_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp, totalSize=176.8 K 2023-10-30 14:53:29,147 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting a99ad36d3029469583b300a70ec8d5ff, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878852219 2023-10-30 14:53:29,147 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/d0ca4c1874db4d5cb8657551c77bf11e_SeqId_44_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/d0ca4c1874db4d5cb8657551c77bf11e_SeqId_44_ 2023-10-30 14:53:29,147 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting f23a31c3733c497f838d068a8aad632b, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621252219 2023-10-30 14:53:29,148 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 4d4f30c8b70940e98f46aa25e560d9b4_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965252219 2023-10-30 14:53:29,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 14:53:29,149 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:29,151 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512011c21abfa712346bc80b1eab11f9f73ba to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512011c21abfa712346bc80b1eab11f9f73ba 2023-10-30 14:53:29,152 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ad476860b9624ff6a00f38cd75a1e1cf to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ad476860b9624ff6a00f38cd75a1e1cf 2023-10-30 14:53:29,152 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-10-30 14:53:29,152 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-30 14:53:29,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:29,153 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 14:53:29,153 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:53:29,154 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 14:53:29,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8580 sec 2023-10-30 14:53:29,168 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] throttle.PressureAwareThroughputController(145): 152dd2029edf29e5f98fc7ec046f7767#family1#compaction#35 average throughput is 19.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:53:29,251 INFO [Listener at localhost/34621] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=259 (was 254) - Thread LEAK? -, OpenFileDescriptor=617 (was 613) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=346 (was 391), ProcessCount=168 (was 168), AvailableMemoryMB=2126 (was 2222) 2023-10-30 14:53:29,261 INFO [Listener at localhost/34621] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=259, OpenFileDescriptor=617, MaxFileDescriptor=60000, SystemLoadAverage=346, ProcessCount=168, AvailableMemoryMB=2125 2023-10-30 14:53:29,284 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 14:53:29,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-30 14:53:29,284 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43c0c6f9 to 127.0.0.1:49804 2023-10-30 14:53:29,284 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:53:29,290 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 14:53:29,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:29,290 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59325066 to 127.0.0.1:49804 2023-10-30 14:53:29,290 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:53:29,294 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 14:53:29,294 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42e680fa to 127.0.0.1:49804 2023-10-30 14:53:29,294 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:53:29,294 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 14:53:29,294 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e62cd1c to 127.0.0.1:49804 2023-10-30 14:53:29,294 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:53:29,294 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 14:53:29,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-10-30 14:53:29,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-30 14:53:29,295 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 14:53:29,298 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testScannerOnBulkLoadRefHFiles/704a96c7dc9afead8f729d6f37747ec5 2023-10-30 14:53:29,298 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testScannerOnBulkLoadRefHFiles/48f76e58a4a35e9459816951bbe6c769 2023-10-30 14:53:29,298 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27 2023-10-30 14:53:29,298 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testScannerOnBulkLoadRefHFiles/48f76e58a4a35e9459816951bbe6c769 empty. 2023-10-30 14:53:29,298 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testScannerOnBulkLoadRefHFiles/704a96c7dc9afead8f729d6f37747ec5 empty. 2023-10-30 14:53:29,298 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27 empty. 2023-10-30 14:53:29,299 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testScannerOnBulkLoadRefHFiles/48f76e58a4a35e9459816951bbe6c769 2023-10-30 14:53:29,299 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testScannerOnBulkLoadRefHFiles/704a96c7dc9afead8f729d6f37747ec5 2023-10-30 14:53:29,299 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27 2023-10-30 14:53:29,299 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-10-30 14:53:29,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-30 14:53:29,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-30 14:53:29,712 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-10-30 14:53:29,715 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 704a96c7dc9afead8f729d6f37747ec5, NAME => 'testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:53:29,716 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 47028b3909b824fbdc0fcfdc181fdd27, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:53:29,717 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 48f76e58a4a35e9459816951bbe6c769, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:53:29,728 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:53:29,728 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 47028b3909b824fbdc0fcfdc181fdd27, disabling compactions & flushes 2023-10-30 14:53:29,728 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. 2023-10-30 14:53:29,729 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. 2023-10-30 14:53:29,729 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. after waiting 0 ms 2023-10-30 14:53:29,729 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. 2023-10-30 14:53:29,729 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. 2023-10-30 14:53:29,729 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 47028b3909b824fbdc0fcfdc181fdd27: 2023-10-30 14:53:29,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-30 14:53:30,130 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:53:30,131 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 704a96c7dc9afead8f729d6f37747ec5, disabling compactions & flushes 2023-10-30 14:53:30,131 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. 2023-10-30 14:53:30,131 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. 2023-10-30 14:53:30,131 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. after waiting 0 ms 2023-10-30 14:53:30,131 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. 2023-10-30 14:53:30,131 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. 2023-10-30 14:53:30,131 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:53:30,131 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 704a96c7dc9afead8f729d6f37747ec5: 2023-10-30 14:53:30,132 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 48f76e58a4a35e9459816951bbe6c769, disabling compactions & flushes 2023-10-30 14:53:30,132 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. 2023-10-30 14:53:30,132 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. 2023-10-30 14:53:30,132 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. after waiting 0 ms 2023-10-30 14:53:30,132 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. 2023-10-30 14:53:30,132 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. 2023-10-30 14:53:30,132 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 48f76e58a4a35e9459816951bbe6c769: 2023-10-30 14:53:30,135 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 14:53:30,137 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698677610137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677610137"}]},"ts":"1698677610137"} 2023-10-30 14:53:30,137 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698677610137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677610137"}]},"ts":"1698677610137"} 2023-10-30 14:53:30,137 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698677610137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677610137"}]},"ts":"1698677610137"} 2023-10-30 14:53:30,140 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-30 14:53:30,141 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 14:53:30,141 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677610141"}]},"ts":"1698677610141"} 2023-10-30 14:53:30,142 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-10-30 14:53:30,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=704a96c7dc9afead8f729d6f37747ec5, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=48f76e58a4a35e9459816951bbe6c769, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=47028b3909b824fbdc0fcfdc181fdd27, ASSIGN}] 2023-10-30 14:53:30,147 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=47028b3909b824fbdc0fcfdc181fdd27, ASSIGN 2023-10-30 14:53:30,147 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=48f76e58a4a35e9459816951bbe6c769, ASSIGN 2023-10-30 14:53:30,147 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=704a96c7dc9afead8f729d6f37747ec5, ASSIGN 2023-10-30 14:53:30,148 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=47028b3909b824fbdc0fcfdc181fdd27, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:53:30,148 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=48f76e58a4a35e9459816951bbe6c769, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:53:30,148 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=704a96c7dc9afead8f729d6f37747ec5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:53:30,300 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=704a96c7dc9afead8f729d6f37747ec5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:30,300 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=47028b3909b824fbdc0fcfdc181fdd27, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:30,300 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=48f76e58a4a35e9459816951bbe6c769, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:30,300 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698677610300"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677610300"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677610300"}]},"ts":"1698677610300"} 2023-10-30 14:53:30,301 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698677610300"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677610300"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677610300"}]},"ts":"1698677610300"} 2023-10-30 14:53:30,301 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698677610300"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677610300"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677610300"}]},"ts":"1698677610300"} 2023-10-30 14:53:30,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 704a96c7dc9afead8f729d6f37747ec5, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:53:30,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure 47028b3909b824fbdc0fcfdc181fdd27, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:53:30,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure 48f76e58a4a35e9459816951bbe6c769, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:53:30,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-30 14:53:30,404 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/.tmp/family1/6515e2beaf8149c99600730b30fb13c9 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/6515e2beaf8149c99600730b30fb13c9 2023-10-30 14:53:30,410 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 152dd2029edf29e5f98fc7ec046f7767/family1 of 152dd2029edf29e5f98fc7ec046f7767 into 6515e2beaf8149c99600730b30fb13c9(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:53:30,410 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 152dd2029edf29e5f98fc7ec046f7767: 2023-10-30 14:53:30,410 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1698677609146; duration=1sec 2023-10-30 14:53:30,410 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:53:30,422 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/a99ad36d3029469583b300a70ec8d5ff, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/f23a31c3733c497f838d068a8aad632b, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/4d4f30c8b70940e98f46aa25e560d9b4_SeqId_47_] to archive 2023-10-30 14:53:30,423 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:30,425 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/a99ad36d3029469583b300a70ec8d5ff to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/a99ad36d3029469583b300a70ec8d5ff 2023-10-30 14:53:30,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/f23a31c3733c497f838d068a8aad632b to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/f23a31c3733c497f838d068a8aad632b 2023-10-30 14:53:30,428 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/4d4f30c8b70940e98f46aa25e560d9b4_SeqId_47_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/family1/4d4f30c8b70940e98f46aa25e560d9b4_SeqId_47_ 2023-10-30 14:53:30,456 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:30,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. 2023-10-30 14:53:30,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 48f76e58a4a35e9459816951bbe6c769, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769.', STARTKEY => '1', ENDKEY => '2'} 2023-10-30 14:53:30,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 48f76e58a4a35e9459816951bbe6c769 2023-10-30 14:53:30,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:53:30,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 48f76e58a4a35e9459816951bbe6c769 2023-10-30 14:53:30,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 48f76e58a4a35e9459816951bbe6c769 2023-10-30 14:53:30,460 INFO [StoreOpener-48f76e58a4a35e9459816951bbe6c769-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 48f76e58a4a35e9459816951bbe6c769 2023-10-30 14:53:30,462 DEBUG [StoreOpener-48f76e58a4a35e9459816951bbe6c769-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/48f76e58a4a35e9459816951bbe6c769/family1 2023-10-30 14:53:30,462 DEBUG [StoreOpener-48f76e58a4a35e9459816951bbe6c769-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/48f76e58a4a35e9459816951bbe6c769/family1 2023-10-30 14:53:30,462 INFO [StoreOpener-48f76e58a4a35e9459816951bbe6c769-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 48f76e58a4a35e9459816951bbe6c769 columnFamilyName family1 2023-10-30 14:53:30,464 INFO [StoreOpener-48f76e58a4a35e9459816951bbe6c769-1] regionserver.HStore(310): Store=48f76e58a4a35e9459816951bbe6c769/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:53:30,464 INFO [StoreOpener-48f76e58a4a35e9459816951bbe6c769-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 48f76e58a4a35e9459816951bbe6c769 2023-10-30 14:53:30,465 DEBUG [StoreOpener-48f76e58a4a35e9459816951bbe6c769-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/48f76e58a4a35e9459816951bbe6c769/family2 2023-10-30 14:53:30,465 DEBUG [StoreOpener-48f76e58a4a35e9459816951bbe6c769-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/48f76e58a4a35e9459816951bbe6c769/family2 2023-10-30 14:53:30,465 INFO [StoreOpener-48f76e58a4a35e9459816951bbe6c769-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 48f76e58a4a35e9459816951bbe6c769 columnFamilyName family2 2023-10-30 14:53:30,467 INFO [StoreOpener-48f76e58a4a35e9459816951bbe6c769-1] regionserver.HStore(310): Store=48f76e58a4a35e9459816951bbe6c769/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:53:30,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/48f76e58a4a35e9459816951bbe6c769 2023-10-30 14:53:30,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/48f76e58a4a35e9459816951bbe6c769 2023-10-30 14:53:30,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 14:53:30,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 48f76e58a4a35e9459816951bbe6c769 2023-10-30 14:53:30,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/48f76e58a4a35e9459816951bbe6c769/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:53:30,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 48f76e58a4a35e9459816951bbe6c769; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68860462, jitterRate=0.026100844144821167}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 14:53:30,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 48f76e58a4a35e9459816951bbe6c769: 2023-10-30 14:53:30,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769., pid=33, masterSystemTime=1698677610456 2023-10-30 14:53:30,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. 2023-10-30 14:53:30,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. 2023-10-30 14:53:30,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. 2023-10-30 14:53:30,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 704a96c7dc9afead8f729d6f37747ec5, NAME => 'testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5.', STARTKEY => '', ENDKEY => '1'} 2023-10-30 14:53:30,475 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=48f76e58a4a35e9459816951bbe6c769, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:30,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 704a96c7dc9afead8f729d6f37747ec5 2023-10-30 14:53:30,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:53:30,476 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698677610475"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677610475"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677610475"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677610475"}]},"ts":"1698677610475"} 2023-10-30 14:53:30,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 704a96c7dc9afead8f729d6f37747ec5 2023-10-30 14:53:30,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 704a96c7dc9afead8f729d6f37747ec5 2023-10-30 14:53:30,477 INFO [StoreOpener-704a96c7dc9afead8f729d6f37747ec5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 704a96c7dc9afead8f729d6f37747ec5 2023-10-30 14:53:30,479 DEBUG [StoreOpener-704a96c7dc9afead8f729d6f37747ec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/704a96c7dc9afead8f729d6f37747ec5/family1 2023-10-30 14:53:30,479 DEBUG [StoreOpener-704a96c7dc9afead8f729d6f37747ec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/704a96c7dc9afead8f729d6f37747ec5/family1 2023-10-30 14:53:30,479 INFO [StoreOpener-704a96c7dc9afead8f729d6f37747ec5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 704a96c7dc9afead8f729d6f37747ec5 columnFamilyName family1 2023-10-30 14:53:30,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=29 2023-10-30 14:53:30,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure 48f76e58a4a35e9459816951bbe6c769, server=jenkins-hbase20.apache.org,36359,1698677568317 in 172 msec 2023-10-30 14:53:30,480 INFO [StoreOpener-704a96c7dc9afead8f729d6f37747ec5-1] regionserver.HStore(310): Store=704a96c7dc9afead8f729d6f37747ec5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:53:30,480 INFO [StoreOpener-704a96c7dc9afead8f729d6f37747ec5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 704a96c7dc9afead8f729d6f37747ec5 2023-10-30 14:53:30,481 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=48f76e58a4a35e9459816951bbe6c769, ASSIGN in 334 msec 2023-10-30 14:53:30,482 DEBUG [StoreOpener-704a96c7dc9afead8f729d6f37747ec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/704a96c7dc9afead8f729d6f37747ec5/family2 2023-10-30 14:53:30,482 DEBUG [StoreOpener-704a96c7dc9afead8f729d6f37747ec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/704a96c7dc9afead8f729d6f37747ec5/family2 2023-10-30 14:53:30,483 INFO [StoreOpener-704a96c7dc9afead8f729d6f37747ec5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 704a96c7dc9afead8f729d6f37747ec5 columnFamilyName family2 2023-10-30 14:53:30,484 INFO [StoreOpener-704a96c7dc9afead8f729d6f37747ec5-1] regionserver.HStore(310): Store=704a96c7dc9afead8f729d6f37747ec5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:53:30,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/704a96c7dc9afead8f729d6f37747ec5 2023-10-30 14:53:30,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/704a96c7dc9afead8f729d6f37747ec5 2023-10-30 14:53:30,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 14:53:30,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 704a96c7dc9afead8f729d6f37747ec5 2023-10-30 14:53:30,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/704a96c7dc9afead8f729d6f37747ec5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:53:30,490 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 704a96c7dc9afead8f729d6f37747ec5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68185913, jitterRate=0.016049280762672424}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 14:53:30,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 704a96c7dc9afead8f729d6f37747ec5: 2023-10-30 14:53:30,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5., pid=31, masterSystemTime=1698677610456 2023-10-30 14:53:30,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. 2023-10-30 14:53:30,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. 2023-10-30 14:53:30,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. 2023-10-30 14:53:30,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 47028b3909b824fbdc0fcfdc181fdd27, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27.', STARTKEY => '2', ENDKEY => ''} 2023-10-30 14:53:30,493 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=704a96c7dc9afead8f729d6f37747ec5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:30,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 47028b3909b824fbdc0fcfdc181fdd27 2023-10-30 14:53:30,493 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698677610493"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677610493"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677610493"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677610493"}]},"ts":"1698677610493"} 2023-10-30 14:53:30,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:53:30,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 47028b3909b824fbdc0fcfdc181fdd27 2023-10-30 14:53:30,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 47028b3909b824fbdc0fcfdc181fdd27 2023-10-30 14:53:30,495 INFO [StoreOpener-47028b3909b824fbdc0fcfdc181fdd27-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 47028b3909b824fbdc0fcfdc181fdd27 2023-10-30 14:53:30,497 DEBUG [StoreOpener-47028b3909b824fbdc0fcfdc181fdd27-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1 2023-10-30 14:53:30,497 DEBUG [StoreOpener-47028b3909b824fbdc0fcfdc181fdd27-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1 2023-10-30 14:53:30,497 INFO [StoreOpener-47028b3909b824fbdc0fcfdc181fdd27-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47028b3909b824fbdc0fcfdc181fdd27 columnFamilyName family1 2023-10-30 14:53:30,498 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-10-30 14:53:30,498 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 704a96c7dc9afead8f729d6f37747ec5, server=jenkins-hbase20.apache.org,36359,1698677568317 in 192 msec 2023-10-30 14:53:30,499 INFO [StoreOpener-47028b3909b824fbdc0fcfdc181fdd27-1] regionserver.HStore(310): Store=47028b3909b824fbdc0fcfdc181fdd27/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:53:30,499 INFO [StoreOpener-47028b3909b824fbdc0fcfdc181fdd27-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 47028b3909b824fbdc0fcfdc181fdd27 2023-10-30 14:53:30,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=704a96c7dc9afead8f729d6f37747ec5, ASSIGN in 353 msec 2023-10-30 14:53:30,501 DEBUG [StoreOpener-47028b3909b824fbdc0fcfdc181fdd27-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family2 2023-10-30 14:53:30,501 DEBUG [StoreOpener-47028b3909b824fbdc0fcfdc181fdd27-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family2 2023-10-30 14:53:30,501 INFO [StoreOpener-47028b3909b824fbdc0fcfdc181fdd27-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47028b3909b824fbdc0fcfdc181fdd27 columnFamilyName family2 2023-10-30 14:53:30,502 INFO [StoreOpener-47028b3909b824fbdc0fcfdc181fdd27-1] regionserver.HStore(310): Store=47028b3909b824fbdc0fcfdc181fdd27/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:53:30,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27 2023-10-30 14:53:30,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27 2023-10-30 14:53:30,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 14:53:30,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 47028b3909b824fbdc0fcfdc181fdd27 2023-10-30 14:53:30,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:53:30,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 47028b3909b824fbdc0fcfdc181fdd27; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66205945, jitterRate=-0.013454541563987732}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 14:53:30,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 47028b3909b824fbdc0fcfdc181fdd27: 2023-10-30 14:53:30,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27., pid=32, masterSystemTime=1698677610456 2023-10-30 14:53:30,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. 2023-10-30 14:53:30,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. 2023-10-30 14:53:30,513 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=47028b3909b824fbdc0fcfdc181fdd27, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:30,513 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698677610513"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677610513"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677610513"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677610513"}]},"ts":"1698677610513"} 2023-10-30 14:53:30,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=30 2023-10-30 14:53:30,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure 47028b3909b824fbdc0fcfdc181fdd27, server=jenkins-hbase20.apache.org,36359,1698677568317 in 210 msec 2023-10-30 14:53:30,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=27 2023-10-30 14:53:30,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=47028b3909b824fbdc0fcfdc181fdd27, ASSIGN in 371 msec 2023-10-30 14:53:30,518 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 14:53:30,518 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677610518"}]},"ts":"1698677610518"} 2023-10-30 14:53:30,520 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-10-30 14:53:30,522 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 14:53:30,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2380 sec 2023-10-30 14:53:31,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-30 14:53:31,406 INFO [Listener at localhost/34621] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-10-30 14:53:31,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:31,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:31,418 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-10-30 14:53:31,418 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:31,418 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-10-30 14:53:31,418 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-10-30 14:53:31,419 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:31,419 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:31,420 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:31,420 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:31,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:31,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:31,420 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:31,420 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:31,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:31,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:31,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:31,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:31,422 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:31,422 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:31,422 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-10-30 14:53:31,422 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:31,423 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-10-30 14:53:31,423 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. 2023-10-30 14:53:31,424 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. started... 2023-10-30 14:53:31,424 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. 2023-10-30 14:53:31,424 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. 2023-10-30 14:53:31,424 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 14:53:31,424 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:31,424 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. started... 2023-10-30 14:53:31,424 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 47028b3909b824fbdc0fcfdc181fdd27 2/2 column families, dataSize=48 B heapSize=632 B 2023-10-30 14:53:31,425 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 48f76e58a4a35e9459816951bbe6c769: 2023-10-30 14:53:31,424 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. started... 2023-10-30 14:53:31,425 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. 2023-10-30 14:53:31,426 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 704a96c7dc9afead8f729d6f37747ec5: 2023-10-30 14:53:31,426 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. 2023-10-30 14:53:31,426 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 14:53:31,426 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 14:53:31,845 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310301db866de1a304c388fe24f1f5b0deb26 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202310301db866de1a304c388fe24f1f5b0deb26 2023-10-30 14:53:32,256 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/.tmp/family1/82635bd8e3064035b1e3cd7d999e29b7 2023-10-30 14:53:32,263 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/.tmp/family1/82635bd8e3064035b1e3cd7d999e29b7 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/82635bd8e3064035b1e3cd7d999e29b7 2023-10-30 14:53:32,269 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/82635bd8e3064035b1e3cd7d999e29b7, entries=1, sequenceid=5, filesize=4.9 K 2023-10-30 14:53:32,270 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 47028b3909b824fbdc0fcfdc181fdd27 in 846ms, sequenceid=5, compaction requested=false 2023-10-30 14:53:32,271 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-10-30 14:53:32,271 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 47028b3909b824fbdc0fcfdc181fdd27: 2023-10-30 14:53:32,271 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. 2023-10-30 14:53:32,271 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 14:53:32,271 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 14:53:32,271 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:32,272 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-10-30 14:53:32,272 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-10-30 14:53:32,273 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:32,273 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:32,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:32,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:32,274 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:32,274 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:32,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:32,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:32,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:32,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-10-30 14:53:32,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55c9b502[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:32,276 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-10-30 14:53:32,276 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,277 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,277 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-10-30 14:53:32,277 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-10-30 14:53:32,277 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:32,277 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:32,277 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:32,278 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-10-30 14:53:32,278 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:32,278 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:32,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:32,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:32,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:32,278 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-10-30 14:53:32,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:32,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:32,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:32,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:32,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:32,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:32,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-10-30 14:53:32,282 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-10-30 14:53:32,282 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:32,282 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:32,282 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,282 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:32,283 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:32,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:32,284 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,284 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:32,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:32,284 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:32,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:32,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:32,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:32,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,285 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:32,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:32,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:32,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:32,288 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:32,288 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:32,288 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:32,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-10-30 14:53:32,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:32,288 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:32,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:32,288 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:32,288 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,288 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-10-30 14:53:32,288 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:32,288 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:32,288 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:32,289 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:32,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:32,289 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,289 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,389 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:32,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:32,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:32,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:32,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,397 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-10-30 14:53:32,397 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:32,397 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-10-30 14:53:32,398 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-10-30 14:53:32,398 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,398 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,399 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:32,399 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:32,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:32,400 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:32,400 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,401 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,401 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,402 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-10-30 14:53:32,402 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:32,402 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-10-30 14:53:32,402 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:32,402 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-10-30 14:53:32,402 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. 2023-10-30 14:53:32,402 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. started... 2023-10-30 14:53:32,402 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. 2023-10-30 14:53:32,402 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 14:53:32,402 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:32,402 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. 2023-10-30 14:53:32,402 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 47028b3909b824fbdc0fcfdc181fdd27 2/2 column families, dataSize=90 B heapSize=752 B 2023-10-30 14:53:32,402 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. started... 2023-10-30 14:53:32,402 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. started... 2023-10-30 14:53:32,403 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 704a96c7dc9afead8f729d6f37747ec5: 2023-10-30 14:53:32,403 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. 2023-10-30 14:53:32,403 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 48f76e58a4a35e9459816951bbe6c769: 2023-10-30 14:53:32,403 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 14:53:32,403 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. 2023-10-30 14:53:32,403 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 14:53:32,826 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103009c4e89bb95c41b29c116cf9805ba845 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023103009c4e89bb95c41b29c116cf9805ba845 2023-10-30 14:53:33,233 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/.tmp/family1/0c6522936ffb49f0a75ffbfc8a6b2991 2023-10-30 14:53:33,246 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/.tmp/family1/0c6522936ffb49f0a75ffbfc8a6b2991 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/0c6522936ffb49f0a75ffbfc8a6b2991 2023-10-30 14:53:33,251 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/0c6522936ffb49f0a75ffbfc8a6b2991, entries=2, sequenceid=9, filesize=5.0 K 2023-10-30 14:53:33,252 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 47028b3909b824fbdc0fcfdc181fdd27 in 850ms, sequenceid=9, compaction requested=false 2023-10-30 14:53:33,252 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 47028b3909b824fbdc0fcfdc181fdd27: 2023-10-30 14:53:33,252 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. 2023-10-30 14:53:33,253 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 14:53:33,253 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 14:53:33,253 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:33,253 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-10-30 14:53:33,253 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-10-30 14:53:33,254 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:33,254 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:33,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:33,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:33,254 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,255 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:33,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:33,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:33,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:33,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:33,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-10-30 14:53:33,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e6fb43a[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:33,257 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-10-30 14:53:33,257 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,258 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,258 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-10-30 14:53:33,258 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-10-30 14:53:33,258 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:33,258 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:33,258 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:33,260 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:33,260 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-10-30 14:53:33,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:33,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:33,260 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:33,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:33,260 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-10-30 14:53:33,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:33,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:33,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:33,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:33,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:33,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:33,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-10-30 14:53:33,263 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-10-30 14:53:33,264 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:33,264 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:33,264 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,264 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:33,267 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,267 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,267 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:33,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:33,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:33,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:33,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:33,268 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:33,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:33,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:33,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,270 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:33,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:33,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:33,282 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:33,282 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:33,282 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,282 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:33,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-10-30 14:53:33,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:33,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:33,282 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:33,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-10-30 14:53:33,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:33,282 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,282 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:33,282 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,282 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:33,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:33,282 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,283 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:33,283 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:33,383 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:33,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:33,398 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43911] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-10-30 14:53:33,400 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-30 14:53:33,400 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-30 14:53:33,401 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:53:33,401 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698678213401 2023-10-30 14:53:33,402 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 14:53:33,402 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-10-30 14:53:33,402 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-30 14:53:33,404 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] zookeeper.ReadOnlyZKClient(139): Connect 0x3ee17499 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:53:33,408 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7322da57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:53:33,408 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231030 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-10-30 14:53:34,248 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030cc2f69e461d74038a68ab3124e398188 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231030cc2f69e461d74038a68ab3124e398188 2023-10-30 14:53:34,250 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-30 14:53:34,265 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:53:34,266 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59870, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:53:34,274 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 14:53:34,277 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 14:53:34,286 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231030/family1/3fc8c589688e498db14d4193c9e57aea first=Optional[k0] last=Optional[k1] 2023-10-30 14:53:34,287 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231030/family1/3fc8c589688e498db14d4193c9e57aea}] 2023-10-30 14:53:34,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231030/family1/3fc8c589688e498db14d4193c9e57aea for inclusion in 47028b3909b824fbdc0fcfdc181fdd27/family1 2023-10-30 14:53:34,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-10-30 14:53:34,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-30 14:53:34,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 47028b3909b824fbdc0fcfdc181fdd27: 2023-10-30 14:53:34,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231030/family1/3fc8c589688e498db14d4193c9e57aea to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testScannerOnBulkLoadRefHFiles__i87ka5cs8g8pdmokoa6tlc41n00ljdt8j8o7fum3b338serm0rl4uvjn1oks4h26/family1/3fc8c589688e498db14d4193c9e57aea 2023-10-30 14:53:34,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testScannerOnBulkLoadRefHFiles__i87ka5cs8g8pdmokoa6tlc41n00ljdt8j8o7fum3b338serm0rl4uvjn1oks4h26/family1/3fc8c589688e498db14d4193c9e57aea as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/3403e9eef26d4ebabb75612293b9a3a6_SeqId_12_ 2023-10-30 14:53:34,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testScannerOnBulkLoadRefHFiles__i87ka5cs8g8pdmokoa6tlc41n00ljdt8j8o7fum3b338serm0rl4uvjn1oks4h26/family1/3fc8c589688e498db14d4193c9e57aea into 47028b3909b824fbdc0fcfdc181fdd27/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/3403e9eef26d4ebabb75612293b9a3a6_SeqId_12_ - updating store file list. 2023-10-30 14:53:34,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/3403e9eef26d4ebabb75612293b9a3a6_SeqId_12_ into 47028b3909b824fbdc0fcfdc181fdd27/family1 2023-10-30 14:53:34,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testScannerOnBulkLoadRefHFiles__i87ka5cs8g8pdmokoa6tlc41n00ljdt8j8o7fum3b338serm0rl4uvjn1oks4h26/family1/3fc8c589688e498db14d4193c9e57aea into 47028b3909b824fbdc0fcfdc181fdd27/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/3403e9eef26d4ebabb75612293b9a3a6_SeqId_12_) 2023-10-30 14:53:34,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testScannerOnBulkLoadRefHFiles__i87ka5cs8g8pdmokoa6tlc41n00ljdt8j8o7fum3b338serm0rl4uvjn1oks4h26/family1/3fc8c589688e498db14d4193c9e57aea 2023-10-30 14:53:34,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 14:53:34,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 14:53:34,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(1912): 47028b3909b824fbdc0fcfdc181fdd27/family1 is initiating minor compaction (all files) 2023-10-30 14:53:34,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2e1fb9b7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-30 14:53:34,305 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 47028b3909b824fbdc0fcfdc181fdd27/family1 in testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. 2023-10-30 14:53:34,305 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/82635bd8e3064035b1e3cd7d999e29b7, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/0c6522936ffb49f0a75ffbfc8a6b2991, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/3403e9eef26d4ebabb75612293b9a3a6_SeqId_12_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/.tmp, totalSize=15.1 K 2023-10-30 14:53:34,305 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 82635bd8e3064035b1e3cd7d999e29b7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677611406 2023-10-30 14:53:34,306 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 0c6522936ffb49f0a75ffbfc8a6b2991, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677611406 2023-10-30 14:53:34,306 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 3403e9eef26d4ebabb75612293b9a3a6_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677611406 2023-10-30 14:53:34,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-30 14:53:34,308 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:34,310 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023103009c4e89bb95c41b29c116cf9805ba845 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023103009c4e89bb95c41b29c116cf9805ba845 2023-10-30 14:53:34,311 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202310301db866de1a304c388fe24f1f5b0deb26 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202310301db866de1a304c388fe24f1f5b0deb26 2023-10-30 14:53:34,311 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-10-30 14:53:34,311 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231030' 2023-10-30 14:53:34,313 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231030 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-10-30 14:53:34,313 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-30 14:53:34,313 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:53:34,314 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-30 14:53:34,316 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 915 msec 2023-10-30 14:53:34,318 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] throttle.PressureAwareThroughputController(145): 47028b3909b824fbdc0fcfdc181fdd27#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:53:34,344 INFO [Listener at localhost/34621] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=247 (was 259), OpenFileDescriptor=585 (was 617), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=326 (was 346), ProcessCount=168 (was 168), AvailableMemoryMB=2081 (was 2125) 2023-10-30 14:53:34,356 INFO [Listener at localhost/34621] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=246, OpenFileDescriptor=585, MaxFileDescriptor=60000, SystemLoadAverage=326, ProcessCount=168, AvailableMemoryMB=2080 2023-10-30 14:53:34,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 14:53:34,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:34,361 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 14:53:34,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-10-30 14:53:34,362 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 14:53:34,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 14:53:34,363 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58 2023-10-30 14:53:34,364 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58 empty. 2023-10-30 14:53:34,365 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58 2023-10-30 14:53:34,365 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-10-30 14:53:34,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 14:53:34,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 14:53:34,775 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-30 14:53:34,777 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => ae3648a2636fe2f7065dcbeb2d18bd58, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:53:34,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 14:53:35,189 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:53:35,189 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing ae3648a2636fe2f7065dcbeb2d18bd58, disabling compactions & flushes 2023-10-30 14:53:35,189 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:35,190 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:35,190 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. after waiting 0 ms 2023-10-30 14:53:35,190 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:35,190 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:35,190 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for ae3648a2636fe2f7065dcbeb2d18bd58: 2023-10-30 14:53:35,197 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 14:53:35,199 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698677615199"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677615199"}]},"ts":"1698677615199"} 2023-10-30 14:53:35,201 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 14:53:35,202 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 14:53:35,202 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677615202"}]},"ts":"1698677615202"} 2023-10-30 14:53:35,203 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-10-30 14:53:35,206 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=ae3648a2636fe2f7065dcbeb2d18bd58, ASSIGN}] 2023-10-30 14:53:35,207 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=ae3648a2636fe2f7065dcbeb2d18bd58, ASSIGN 2023-10-30 14:53:35,208 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=ae3648a2636fe2f7065dcbeb2d18bd58, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:53:35,360 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=ae3648a2636fe2f7065dcbeb2d18bd58, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:35,360 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698677615360"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677615360"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677615360"}]},"ts":"1698677615360"} 2023-10-30 14:53:35,364 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure ae3648a2636fe2f7065dcbeb2d18bd58, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:53:35,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 14:53:35,519 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:35,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:35,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ae3648a2636fe2f7065dcbeb2d18bd58, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58.', STARTKEY => '', ENDKEY => ''} 2023-10-30 14:53:35,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy ae3648a2636fe2f7065dcbeb2d18bd58 2023-10-30 14:53:35,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:53:35,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ae3648a2636fe2f7065dcbeb2d18bd58 2023-10-30 14:53:35,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ae3648a2636fe2f7065dcbeb2d18bd58 2023-10-30 14:53:35,525 INFO [StoreOpener-ae3648a2636fe2f7065dcbeb2d18bd58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ae3648a2636fe2f7065dcbeb2d18bd58 2023-10-30 14:53:35,527 DEBUG [StoreOpener-ae3648a2636fe2f7065dcbeb2d18bd58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1 2023-10-30 14:53:35,527 DEBUG [StoreOpener-ae3648a2636fe2f7065dcbeb2d18bd58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1 2023-10-30 14:53:35,527 INFO [StoreOpener-ae3648a2636fe2f7065dcbeb2d18bd58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae3648a2636fe2f7065dcbeb2d18bd58 columnFamilyName family1 2023-10-30 14:53:35,529 INFO [StoreOpener-ae3648a2636fe2f7065dcbeb2d18bd58-1] regionserver.HStore(310): Store=ae3648a2636fe2f7065dcbeb2d18bd58/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:53:35,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58 2023-10-30 14:53:35,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58 2023-10-30 14:53:35,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ae3648a2636fe2f7065dcbeb2d18bd58 2023-10-30 14:53:35,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:53:35,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ae3648a2636fe2f7065dcbeb2d18bd58; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74104511, jitterRate=0.10424326360225677}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 14:53:35,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ae3648a2636fe2f7065dcbeb2d18bd58: 2023-10-30 14:53:35,538 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58., pid=37, masterSystemTime=1698677615519 2023-10-30 14:53:35,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:35,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:35,541 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=ae3648a2636fe2f7065dcbeb2d18bd58, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:35,541 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698677615540"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677615540"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677615540"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677615540"}]},"ts":"1698677615540"} 2023-10-30 14:53:35,545 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-30 14:53:35,545 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure ae3648a2636fe2f7065dcbeb2d18bd58, server=jenkins-hbase20.apache.org,36359,1698677568317 in 179 msec 2023-10-30 14:53:35,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-10-30 14:53:35,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=ae3648a2636fe2f7065dcbeb2d18bd58, ASSIGN in 339 msec 2023-10-30 14:53:35,548 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 14:53:35,548 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677615548"}]},"ts":"1698677615548"} 2023-10-30 14:53:35,550 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-10-30 14:53:35,551 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/.tmp/family1/ee730f0827984106809bb0b75ff660dc as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/ee730f0827984106809bb0b75ff660dc 2023-10-30 14:53:35,551 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 14:53:35,553 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1930 sec 2023-10-30 14:53:35,556 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 47028b3909b824fbdc0fcfdc181fdd27/family1 of 47028b3909b824fbdc0fcfdc181fdd27 into ee730f0827984106809bb0b75ff660dc(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:53:35,556 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 47028b3909b824fbdc0fcfdc181fdd27: 2023-10-30 14:53:35,556 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1698677614305; duration=1sec 2023-10-30 14:53:35,556 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:53:35,636 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/82635bd8e3064035b1e3cd7d999e29b7, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/0c6522936ffb49f0a75ffbfc8a6b2991, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/3403e9eef26d4ebabb75612293b9a3a6_SeqId_12_] to archive 2023-10-30 14:53:35,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:35,642 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/82635bd8e3064035b1e3cd7d999e29b7 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/82635bd8e3064035b1e3cd7d999e29b7 2023-10-30 14:53:35,644 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/0c6522936ffb49f0a75ffbfc8a6b2991 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/0c6522936ffb49f0a75ffbfc8a6b2991 2023-10-30 14:53:35,646 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/3403e9eef26d4ebabb75612293b9a3a6_SeqId_12_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/family1/3403e9eef26d4ebabb75612293b9a3a6_SeqId_12_ 2023-10-30 14:53:35,992 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 14:53:36,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 14:53:36,470 INFO [Listener at localhost/34621] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-10-30 14:53:36,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:36,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:36,494 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:36,494 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:36,494 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:36,494 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:36,494 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:36,494 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:36,495 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:36,495 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:36,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:36,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:36,495 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:36,495 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:36,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:36,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:36,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:36,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:36,496 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:36,496 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:36,496 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:36,496 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:36,496 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:36,496 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:36,496 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:36,496 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:36,496 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. started... 2023-10-30 14:53:36,497 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ae3648a2636fe2f7065dcbeb2d18bd58 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 14:53:36,927 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130d1ba3d7fa5a546c3864f8a6fbe3007f1 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130d1ba3d7fa5a546c3864f8a6fbe3007f1 2023-10-30 14:53:37,333 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/562fbeb400d44b7db6edfe10e0295391 2023-10-30 14:53:37,344 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/562fbeb400d44b7db6edfe10e0295391 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/562fbeb400d44b7db6edfe10e0295391 2023-10-30 14:53:37,351 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/562fbeb400d44b7db6edfe10e0295391, entries=1000, sequenceid=5, filesize=165.1 K 2023-10-30 14:53:37,351 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ae3648a2636fe2f7065dcbeb2d18bd58 in 854ms, sequenceid=5, compaction requested=false 2023-10-30 14:53:37,351 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:37,352 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ae3648a2636fe2f7065dcbeb2d18bd58: 2023-10-30 14:53:37,352 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:37,352 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:37,352 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:37,352 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:37,352 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:37,352 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:37,353 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:37,353 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:37,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:37,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:37,354 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:37,354 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:37,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:37,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:37,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:37,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:37,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d918feb[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:37,355 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:37,355 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,356 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,356 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:37,356 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:37,356 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:37,356 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:37,356 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:37,357 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:37,357 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:37,357 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:37,357 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:37,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:37,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:37,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:37,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:37,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:37,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:37,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:37,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:37,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:37,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:37,359 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:37,359 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:37,359 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:37,359 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,360 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:37,360 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,360 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:37,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:37,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,361 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:37,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:37,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:37,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:37,361 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:37,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:37,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:37,362 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:37,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:37,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:37,363 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:37,363 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,363 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,363 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:37,363 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:37,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:37,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:37,363 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:37,363 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:37,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:37,363 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:37,364 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,364 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:37,364 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,364 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:37,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:37,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:37,464 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:37,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:37,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:37,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:37,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,475 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:37,475 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:37,475 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:37,475 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:37,475 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,475 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,476 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:37,476 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:37,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:37,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:37,476 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:37,477 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:37,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:37,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,477 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,477 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:37,477 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:37,478 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:37,478 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:37,478 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:37,478 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:37,478 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:37,478 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:37,478 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. started... 2023-10-30 14:53:37,478 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ae3648a2636fe2f7065dcbeb2d18bd58 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 14:53:37,900 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286de58f2dda274dbeaae2a6ede6c10f5c to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511286de58f2dda274dbeaae2a6ede6c10f5c 2023-10-30 14:53:38,310 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/7daa419e8e6e47e3993a2ac6a98d4b9c 2023-10-30 14:53:38,317 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/7daa419e8e6e47e3993a2ac6a98d4b9c as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/7daa419e8e6e47e3993a2ac6a98d4b9c 2023-10-30 14:53:38,323 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/7daa419e8e6e47e3993a2ac6a98d4b9c, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 14:53:38,324 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ae3648a2636fe2f7065dcbeb2d18bd58 in 846ms, sequenceid=9, compaction requested=false 2023-10-30 14:53:38,325 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ae3648a2636fe2f7065dcbeb2d18bd58: 2023-10-30 14:53:38,325 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:38,325 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:38,325 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:38,325 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:38,325 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:38,325 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:38,327 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:38,327 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:38,328 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:38,328 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:38,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:38,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:38,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:38,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:38,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27683182[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:38,330 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:38,330 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,334 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,334 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:38,334 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:38,334 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:38,334 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:38,334 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:38,336 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:38,336 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:38,336 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:38,336 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:38,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:38,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:38,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:38,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:38,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:38,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:38,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:38,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:38,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:38,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:38,340 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:38,340 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:38,340 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:38,340 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,340 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:38,342 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,342 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:38,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:38,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,342 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:38,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:38,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:38,343 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:38,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:38,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:38,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:38,345 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:38,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:38,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:38,349 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:38,349 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:38,349 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:38,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:38,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:38,349 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:38,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:38,349 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:38,349 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,350 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:38,350 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:38,350 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:38,350 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:38,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:38,350 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,350 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,450 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:38,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:38,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:38,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:38,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,461 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:38,461 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:38,461 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:38,461 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:38,462 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,462 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,463 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:38,463 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:38,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:38,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:38,463 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:38,463 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:38,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,464 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:38,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,465 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,465 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:38,465 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:38,465 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:38,465 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:38,465 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:38,465 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:38,465 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:38,465 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:38,465 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. started... 2023-10-30 14:53:38,465 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ae3648a2636fe2f7065dcbeb2d18bd58 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:38,886 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201f24526e52f694f80ba5088693ff75cd2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201f24526e52f694f80ba5088693ff75cd2 2023-10-30 14:53:39,296 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/86037e5f293f4ff49672e9bad7d18be0 2023-10-30 14:53:39,307 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/86037e5f293f4ff49672e9bad7d18be0 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/86037e5f293f4ff49672e9bad7d18be0 2023-10-30 14:53:39,312 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/86037e5f293f4ff49672e9bad7d18be0, entries=1, sequenceid=13, filesize=4.9 K 2023-10-30 14:53:39,313 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ae3648a2636fe2f7065dcbeb2d18bd58 in 848ms, sequenceid=13, compaction requested=true 2023-10-30 14:53:39,313 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ae3648a2636fe2f7065dcbeb2d18bd58: 2023-10-30 14:53:39,313 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:39,314 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:39,314 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:39,314 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:39,314 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:39,314 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:39,315 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:39,315 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:39,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:39,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:39,316 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,316 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:39,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:39,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:39,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:39,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:39,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:39,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f11f1c8[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:39,318 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:39,318 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,319 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,319 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:39,319 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:39,319 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:39,319 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:39,320 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:39,321 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:39,321 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:39,321 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:39,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:39,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:39,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:39,321 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:39,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:39,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:39,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:39,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:39,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:39,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:39,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:39,324 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:39,324 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:39,324 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:39,324 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,324 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:39,327 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,327 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:39,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:39,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,327 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:39,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:39,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:39,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:39,328 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:39,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:39,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:39,329 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:39,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:39,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:39,331 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:39,331 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:39,331 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:39,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:39,331 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:39,331 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:39,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:39,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:39,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:39,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:39,331 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,332 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:39,332 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,332 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,332 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,332 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:39,332 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:39,432 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:39,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:39,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:39,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:39,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,439 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:39,439 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:39,439 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:39,439 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:39,440 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,440 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,441 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:39,441 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:39,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:39,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:39,441 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:39,441 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:39,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:39,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,442 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,442 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:39,442 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:39,442 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:39,442 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:39,442 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:39,442 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:39,442 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:39,442 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:39,442 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. started... 2023-10-30 14:53:39,443 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ae3648a2636fe2f7065dcbeb2d18bd58 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:39,861 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512050d484983e36241a6b79218289feaa307 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512050d484983e36241a6b79218289feaa307 2023-10-30 14:53:40,269 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/1e3b603756f0424cab54a514bf585e04 2023-10-30 14:53:40,281 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/1e3b603756f0424cab54a514bf585e04 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/1e3b603756f0424cab54a514bf585e04 2023-10-30 14:53:40,287 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/1e3b603756f0424cab54a514bf585e04, entries=1, sequenceid=17, filesize=4.9 K 2023-10-30 14:53:40,288 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ae3648a2636fe2f7065dcbeb2d18bd58 in 845ms, sequenceid=17, compaction requested=true 2023-10-30 14:53:40,289 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ae3648a2636fe2f7065dcbeb2d18bd58: 2023-10-30 14:53:40,289 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:40,289 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:40,289 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:40,289 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:40,289 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:40,289 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:40,290 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:40,290 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:40,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:40,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:40,291 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,291 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:40,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:40,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:40,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:40,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:40,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:40,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c5c5c74[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:40,293 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:40,293 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,294 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,294 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:40,294 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:40,294 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:40,295 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:40,295 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:40,296 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:40,296 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:40,296 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:40,296 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:40,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:40,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:40,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:40,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:40,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:40,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:40,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:40,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:40,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:40,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:40,300 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:40,300 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:40,300 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:40,300 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,300 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:40,309 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,309 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:40,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:40,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,309 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:40,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:40,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:40,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:40,310 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:40,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:40,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,312 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:40,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:40,317 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:40,317 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,317 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,317 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:40,317 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:40,317 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:40,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 14:53:40,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:40,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:40,317 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:40,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:40,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:40,317 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,318 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,318 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:40,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:40,318 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:40,318 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:40,419 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:40,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:40,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:40,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:40,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,432 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:40,432 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:40,432 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:40,432 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:40,433 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,433 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,435 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:40,435 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:40,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:40,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:40,436 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:40,436 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:40,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,438 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,438 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:40,438 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:40,438 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:40,439 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:40,439 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:40,439 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:40,439 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:40,439 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:40,439 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. started... 2023-10-30 14:53:40,439 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ae3648a2636fe2f7065dcbeb2d18bd58 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:40,865 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122877ceb51f5a69493d84062871910c6511 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122877ceb51f5a69493d84062871910c6511 2023-10-30 14:53:41,028 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 14:53:41,274 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/3134faa2f4c64952b38be83f2bd6fe88 2023-10-30 14:53:41,284 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/3134faa2f4c64952b38be83f2bd6fe88 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/3134faa2f4c64952b38be83f2bd6fe88 2023-10-30 14:53:41,290 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/3134faa2f4c64952b38be83f2bd6fe88, entries=1, sequenceid=21, filesize=4.9 K 2023-10-30 14:53:41,291 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ae3648a2636fe2f7065dcbeb2d18bd58 in 852ms, sequenceid=21, compaction requested=true 2023-10-30 14:53:41,291 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ae3648a2636fe2f7065dcbeb2d18bd58: 2023-10-30 14:53:41,291 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:41,291 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:41,291 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:41,291 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:41,291 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:41,291 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:41,292 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,292 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:41,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:41,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:41,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:41,293 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,293 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:41,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:41,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:41,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:41,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:41,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:41,295 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:41,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d1372c3[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:41,295 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,295 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,296 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:41,296 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:41,296 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:41,296 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:41,296 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:41,296 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:41,296 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:41,296 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:41,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:41,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:41,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:41,297 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:41,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:41,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:41,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:41,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:41,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:41,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:41,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:41,299 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:41,300 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:41,300 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:41,300 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,300 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:41,301 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,301 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:41,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:41,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,301 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:41,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:41,302 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:41,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:41,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:41,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:41,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,303 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:41,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:41,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:41,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:41,306 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:41,306 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,306 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:41,306 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:41,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:41,306 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:41,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 14:53:41,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:41,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:41,306 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:41,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:41,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:41,306 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:41,307 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:41,307 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:41,307 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,307 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,307 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,407 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:41,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:41,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:41,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:41,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,421 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:41,421 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:41,421 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:41,421 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:41,421 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,421 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,422 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:41,422 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:41,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:41,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:41,423 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:41,423 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:41,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,423 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:41,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,424 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,424 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:41,424 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:41,424 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:41,424 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:41,424 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:41,424 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:41,424 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:41,424 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:41,424 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. started... 2023-10-30 14:53:41,425 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ae3648a2636fe2f7065dcbeb2d18bd58 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:41,843 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316d707fb55ba245e8a94b8a5fe8718fe2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512316d707fb55ba245e8a94b8a5fe8718fe2 2023-10-30 14:53:42,253 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/8a6f284910a540ea99fc3bfea7c39d76 2023-10-30 14:53:42,266 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/8a6f284910a540ea99fc3bfea7c39d76 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/8a6f284910a540ea99fc3bfea7c39d76 2023-10-30 14:53:42,271 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/8a6f284910a540ea99fc3bfea7c39d76, entries=1, sequenceid=25, filesize=4.9 K 2023-10-30 14:53:42,272 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ae3648a2636fe2f7065dcbeb2d18bd58 in 847ms, sequenceid=25, compaction requested=true 2023-10-30 14:53:42,272 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ae3648a2636fe2f7065dcbeb2d18bd58: 2023-10-30 14:53:42,272 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:42,272 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:42,272 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:42,272 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:42,272 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:42,272 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:42,274 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:42,274 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:42,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:42,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:42,274 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,274 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:42,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:42,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:42,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:42,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:42,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:42,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b91b4c2[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:42,277 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:42,277 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,278 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,278 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:42,278 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:42,278 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:42,278 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:42,278 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:42,279 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:42,279 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:42,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:42,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:42,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:42,279 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:42,280 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:42,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:42,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:42,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:42,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:42,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:42,283 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:42,283 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:42,284 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:42,284 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,284 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:42,396 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,397 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:42,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,396 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:42,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:42,397 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,399 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:42,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:42,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:42,401 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:42,401 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,401 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:42,401 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,401 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:42,401 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:42,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:42,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:42,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:42,401 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:42,401 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,402 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,402 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:42,401 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 14:53:42,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:42,402 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:42,402 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:42,502 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:42,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:42,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:42,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:42,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,511 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:42,511 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:42,511 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:42,511 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:42,512 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,512 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,513 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:42,513 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:42,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:42,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:42,513 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:42,513 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:42,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:42,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,514 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,514 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:42,514 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:42,514 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:42,514 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:42,515 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:42,515 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:42,515 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:42,515 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:42,515 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. started... 2023-10-30 14:53:42,515 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ae3648a2636fe2f7065dcbeb2d18bd58 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:42,939 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601015952eceda1494ec587cb8b74bf6cf285 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601015952eceda1494ec587cb8b74bf6cf285 2023-10-30 14:53:43,348 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/93e859be1f6d4c9ba2fd96b8b9719ddc 2023-10-30 14:53:43,353 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/93e859be1f6d4c9ba2fd96b8b9719ddc as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/93e859be1f6d4c9ba2fd96b8b9719ddc 2023-10-30 14:53:43,357 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/93e859be1f6d4c9ba2fd96b8b9719ddc, entries=1, sequenceid=29, filesize=4.9 K 2023-10-30 14:53:43,358 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ae3648a2636fe2f7065dcbeb2d18bd58 in 843ms, sequenceid=29, compaction requested=true 2023-10-30 14:53:43,358 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ae3648a2636fe2f7065dcbeb2d18bd58: 2023-10-30 14:53:43,358 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:43,358 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:43,358 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:43,358 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:43,358 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:43,358 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:43,360 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:43,360 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:43,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:43,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:43,360 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,360 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:43,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:43,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:43,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:43,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:43,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:43,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bbe95c9[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:43,362 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:43,362 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,363 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,363 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:43,363 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:43,363 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:43,364 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:43,364 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:43,365 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:43,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:43,365 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:43,365 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:43,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:43,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:43,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:43,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:43,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:43,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:43,368 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:43,368 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:43,368 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:43,368 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,368 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:43,369 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,369 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,369 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:43,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:43,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:43,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:43,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:43,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:43,370 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:43,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:43,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,372 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:43,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:43,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:43,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:43,376 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:43,376 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:43,376 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:43,376 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,376 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,376 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:43,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 14:53:43,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:43,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:43,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:43,376 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:43,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:43,376 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,376 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,376 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,376 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:43,376 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:43,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:43,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:43,477 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:43,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:43,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:43,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:43,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,492 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:43,492 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:43,492 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:43,492 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:43,493 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,493 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,494 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:43,494 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:43,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:43,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:43,495 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:43,495 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:43,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:43,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,497 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,497 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:43,497 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:43,497 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:43,497 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:43,497 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:43,498 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:43,498 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:43,498 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:43,498 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. started... 2023-10-30 14:53:43,498 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ae3648a2636fe2f7065dcbeb2d18bd58 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:43,918 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010341d95929cb15451abce9b75ae366884b to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010341d95929cb15451abce9b75ae366884b 2023-10-30 14:53:44,327 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/11e694fa7a644d5e9a8139f613584f04 2023-10-30 14:53:44,338 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/11e694fa7a644d5e9a8139f613584f04 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/11e694fa7a644d5e9a8139f613584f04 2023-10-30 14:53:44,343 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/11e694fa7a644d5e9a8139f613584f04, entries=1, sequenceid=33, filesize=4.9 K 2023-10-30 14:53:44,343 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ae3648a2636fe2f7065dcbeb2d18bd58 in 845ms, sequenceid=33, compaction requested=true 2023-10-30 14:53:44,343 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ae3648a2636fe2f7065dcbeb2d18bd58: 2023-10-30 14:53:44,343 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:44,343 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:44,343 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:44,343 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,343 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:44,343 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:44,345 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,345 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:44,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:44,345 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,345 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:44,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:44,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:44,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:44,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:44,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@155fcf36[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:44,347 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:44,347 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,347 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,348 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:44,348 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:44,348 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:44,348 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,348 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:44,348 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:44,349 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:44,349 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:44,349 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:44,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:44,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:44,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:44,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:44,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:44,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:44,351 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:44,351 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:44,351 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:44,351 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,351 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:44,352 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,353 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:44,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:44,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,353 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:44,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:44,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:44,353 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:44,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:44,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,355 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:44,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,357 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,357 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,357 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:44,357 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:44,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:44,357 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,357 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:44,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:44,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:44,357 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:44,357 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:44,357 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,357 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,357 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,357 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:44,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 14:53:44,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:44,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:44,458 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:44,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:44,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:44,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:44,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,467 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:44,467 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:44,467 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:44,467 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:44,468 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,468 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,469 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:44,469 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:44,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:44,470 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,470 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:44,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:44,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,472 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,472 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:44,473 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,473 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:44,473 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:44,473 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:44,473 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:44,473 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:44,473 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:44,473 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. started... 2023-10-30 14:53:44,473 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ae3648a2636fe2f7065dcbeb2d18bd58 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:44,493 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509075cbe0cd83bd6422a9a9309d5861b2ce2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509075cbe0cd83bd6422a9a9309d5861b2ce2 2023-10-30 14:53:44,899 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/bb9cd4c4fac64633a71e20667f91d506 2023-10-30 14:53:44,905 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/bb9cd4c4fac64633a71e20667f91d506 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/bb9cd4c4fac64633a71e20667f91d506 2023-10-30 14:53:44,911 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/bb9cd4c4fac64633a71e20667f91d506, entries=1, sequenceid=37, filesize=4.9 K 2023-10-30 14:53:44,912 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ae3648a2636fe2f7065dcbeb2d18bd58 in 439ms, sequenceid=37, compaction requested=true 2023-10-30 14:53:44,912 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ae3648a2636fe2f7065dcbeb2d18bd58: 2023-10-30 14:53:44,912 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:44,912 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:44,912 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:44,912 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,912 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:44,912 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:44,914 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,914 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:44,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:44,914 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,914 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:44,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:44,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:44,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:44,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:44,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@135c3234[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:44,917 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:44,917 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,917 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,918 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:44,918 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:44,918 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:44,918 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,918 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:44,919 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,919 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:44,919 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:44,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:44,919 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:44,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:44,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:44,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:44,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:44,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:44,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:44,922 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:44,922 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:44,922 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:44,922 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,922 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:44,923 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,923 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:44,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:44,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,923 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:44,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:44,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:44,924 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:44,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:44,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,925 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:44,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,927 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:44,927 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:44,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 14:53:44,927 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:44,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:44,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:44,927 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,927 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:44,927 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,927 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:44,927 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,927 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:44,927 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:44,927 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:44,928 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:45,028 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:45,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:45,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:45,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:45,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,036 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:45,036 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:45,036 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 14:53:45,036 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 14:53:45,037 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,037 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,038 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:45,038 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:45,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:45,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:45,039 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:45,039 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:45,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,040 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:45,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,040 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,041 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 14:53:45,041 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,041 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 14:53:45,041 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:45,041 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 14:53:45,041 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:45,041 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:45,041 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:45,041 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. started... 2023-10-30 14:53:45,042 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ae3648a2636fe2f7065dcbeb2d18bd58 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:45,467 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511207531c4bd1a40455296e1f3b02b40bd13 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511207531c4bd1a40455296e1f3b02b40bd13 2023-10-30 14:53:45,875 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/f5bcd20256404ebd8a899558dc4db5e2 2023-10-30 14:53:45,880 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/f5bcd20256404ebd8a899558dc4db5e2 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/f5bcd20256404ebd8a899558dc4db5e2 2023-10-30 14:53:45,885 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/f5bcd20256404ebd8a899558dc4db5e2, entries=1, sequenceid=41, filesize=4.9 K 2023-10-30 14:53:45,886 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ae3648a2636fe2f7065dcbeb2d18bd58 in 844ms, sequenceid=41, compaction requested=true 2023-10-30 14:53:45,886 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ae3648a2636fe2f7065dcbeb2d18bd58: 2023-10-30 14:53:45,886 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:45,886 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:45,886 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:45,886 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:45,886 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 14:53:45,886 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 14:53:45,887 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:45,888 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:45,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:45,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:45,888 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,888 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:45,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:45,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:45,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:45,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:45,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 14:53:45,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@659da339[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:45,889 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 14:53:45,889 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,890 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,890 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:45,890 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:45,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,891 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 14:53:45,891 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 14:53:45,891 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:45,892 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 14:53:45,892 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:45,892 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:45,892 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 14:53:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:45,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:45,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:45,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:45,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:45,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:53:45,894 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 14:53:45,894 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:45,894 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:45,894 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,894 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:45,895 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,895 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,895 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:45,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:45,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:45,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:45,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:45,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:45,896 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:45,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:45,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:45,897 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:45,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:45,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:45,900 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:45,900 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:45,900 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:45,900 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:45,900 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:45,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 14:53:45,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:45,900 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,900 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:45,900 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,900 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,900 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:45,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:45,900 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:45,901 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:46,001 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:46,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:46,003 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43911] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-10-30 14:53:46,004 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 14:53:46,005 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 14:53:46,006 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698678226006 2023-10-30 14:53:46,006 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:53:46,009 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 14:53:46,011 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-10-30 14:53:46,011 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 14:53:46,012 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] zookeeper.ReadOnlyZKClient(139): Connect 0x1a57fa20 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:53:46,016 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c744c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:53:46,016 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:46,865 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010367b178b760264b98850e5ce1c4d1eda9 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010367b178b760264b98850e5ce1c4d1eda9 2023-10-30 14:53:46,866 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 14:53:46,880 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:53:46,881 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46028, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:53:46,890 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 14:53:46,891 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 14:53:46,905 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/44704ed8e45c4d5cabf71bd1e56d7b62 first=Optional[r3] last=Optional[r6] 2023-10-30 14:53:46,906 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/44704ed8e45c4d5cabf71bd1e56d7b62}] 2023-10-30 14:53:46,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/44704ed8e45c4d5cabf71bd1e56d7b62 for inclusion in ae3648a2636fe2f7065dcbeb2d18bd58/family1 2023-10-30 14:53:46,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-30 14:53:46,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:53:46,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for ae3648a2636fe2f7065dcbeb2d18bd58: 2023-10-30 14:53:46,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/44704ed8e45c4d5cabf71bd1e56d7b62 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4gh4u5j1tvah98n2mgcudbiu3vd0ak5ks53n1hbhdbg6a0q05epread16qnts899/family1/44704ed8e45c4d5cabf71bd1e56d7b62 2023-10-30 14:53:46,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4gh4u5j1tvah98n2mgcudbiu3vd0ak5ks53n1hbhdbg6a0q05epread16qnts899/family1/44704ed8e45c4d5cabf71bd1e56d7b62 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/f137da9c74614ed897853c6f4d3d6f34_SeqId_44_ 2023-10-30 14:53:46,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4gh4u5j1tvah98n2mgcudbiu3vd0ak5ks53n1hbhdbg6a0q05epread16qnts899/family1/44704ed8e45c4d5cabf71bd1e56d7b62 into ae3648a2636fe2f7065dcbeb2d18bd58/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/f137da9c74614ed897853c6f4d3d6f34_SeqId_44_ - updating store file list. 2023-10-30 14:53:46,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/f137da9c74614ed897853c6f4d3d6f34_SeqId_44_ into ae3648a2636fe2f7065dcbeb2d18bd58/family1 2023-10-30 14:53:46,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4gh4u5j1tvah98n2mgcudbiu3vd0ak5ks53n1hbhdbg6a0q05epread16qnts899/family1/44704ed8e45c4d5cabf71bd1e56d7b62 into ae3648a2636fe2f7065dcbeb2d18bd58/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/f137da9c74614ed897853c6f4d3d6f34_SeqId_44_) 2023-10-30 14:53:46,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4gh4u5j1tvah98n2mgcudbiu3vd0ak5ks53n1hbhdbg6a0q05epread16qnts899/family1/44704ed8e45c4d5cabf71bd1e56d7b62 2023-10-30 14:53:46,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 14:53:46,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 14:53:46,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(1912): ae3648a2636fe2f7065dcbeb2d18bd58/family1 is initiating minor compaction 2023-10-30 14:53:46,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6e8e808e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:53:46,926 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ae3648a2636fe2f7065dcbeb2d18bd58/family1 in testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:46,926 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/7daa419e8e6e47e3993a2ac6a98d4b9c, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/86037e5f293f4ff49672e9bad7d18be0, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/1e3b603756f0424cab54a514bf585e04, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/3134faa2f4c64952b38be83f2bd6fe88, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/8a6f284910a540ea99fc3bfea7c39d76, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/93e859be1f6d4c9ba2fd96b8b9719ddc, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/11e694fa7a644d5e9a8139f613584f04, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/bb9cd4c4fac64633a71e20667f91d506, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/f5bcd20256404ebd8a899558dc4db5e2, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/f137da9c74614ed897853c6f4d3d6f34_SeqId_44_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp, totalSize=50.0 K 2023-10-30 14:53:46,926 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 7daa419e8e6e47e3993a2ac6a98d4b9c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 14:53:46,926 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 86037e5f293f4ff49672e9bad7d18be0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 14:53:46,926 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 1e3b603756f0424cab54a514bf585e04, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 14:53:46,926 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 3134faa2f4c64952b38be83f2bd6fe88, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 14:53:46,926 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 8a6f284910a540ea99fc3bfea7c39d76, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 14:53:46,926 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 93e859be1f6d4c9ba2fd96b8b9719ddc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 14:53:46,926 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 11e694fa7a644d5e9a8139f613584f04, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 14:53:46,927 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting bb9cd4c4fac64633a71e20667f91d506, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 14:53:46,927 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting f5bcd20256404ebd8a899558dc4db5e2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 14:53:46,927 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting f137da9c74614ed897853c6f4d3d6f34_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 14:53:46,928 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 14:53:46,929 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:46,930 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122877ceb51f5a69493d84062871910c6511 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122877ceb51f5a69493d84062871910c6511 2023-10-30 14:53:46,931 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512316d707fb55ba245e8a94b8a5fe8718fe2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512316d707fb55ba245e8a94b8a5fe8718fe2 2023-10-30 14:53:46,932 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601015952eceda1494ec587cb8b74bf6cf285 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601015952eceda1494ec587cb8b74bf6cf285 2023-10-30 14:53:46,934 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010341d95929cb15451abce9b75ae366884b to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010341d95929cb15451abce9b75ae366884b 2023-10-30 14:53:46,934 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-10-30 14:53:46,934 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-30 14:53:46,934 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:46,934 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:46,934 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:46,936 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:46,937 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:46,937 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:46,937 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:46,937 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:47,006 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] throttle.PressureAwareThroughputController(145): ae3648a2636fe2f7065dcbeb2d18bd58#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:53:47,470 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/ec4f3071ee3548cb9fef5c9a1d855fa2 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/ec4f3071ee3548cb9fef5c9a1d855fa2 2023-10-30 14:53:47,475 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ae3648a2636fe2f7065dcbeb2d18bd58/family1 of ae3648a2636fe2f7065dcbeb2d18bd58 into ec4f3071ee3548cb9fef5c9a1d855fa2(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:53:47,475 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ae3648a2636fe2f7065dcbeb2d18bd58: 2023-10-30 14:53:47,475 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698677626925; duration=0sec 2023-10-30 14:53:47,475 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:53:47,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/7daa419e8e6e47e3993a2ac6a98d4b9c, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/86037e5f293f4ff49672e9bad7d18be0, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/1e3b603756f0424cab54a514bf585e04, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/3134faa2f4c64952b38be83f2bd6fe88, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/8a6f284910a540ea99fc3bfea7c39d76, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/93e859be1f6d4c9ba2fd96b8b9719ddc, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/11e694fa7a644d5e9a8139f613584f04, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/bb9cd4c4fac64633a71e20667f91d506, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/f5bcd20256404ebd8a899558dc4db5e2, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/f137da9c74614ed897853c6f4d3d6f34_SeqId_44_] to archive 2023-10-30 14:53:47,537 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:47,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/7daa419e8e6e47e3993a2ac6a98d4b9c to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/7daa419e8e6e47e3993a2ac6a98d4b9c 2023-10-30 14:53:47,540 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/86037e5f293f4ff49672e9bad7d18be0 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/86037e5f293f4ff49672e9bad7d18be0 2023-10-30 14:53:47,541 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/1e3b603756f0424cab54a514bf585e04 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/1e3b603756f0424cab54a514bf585e04 2023-10-30 14:53:47,542 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/3134faa2f4c64952b38be83f2bd6fe88 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/3134faa2f4c64952b38be83f2bd6fe88 2023-10-30 14:53:47,543 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/8a6f284910a540ea99fc3bfea7c39d76 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/8a6f284910a540ea99fc3bfea7c39d76 2023-10-30 14:53:47,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/93e859be1f6d4c9ba2fd96b8b9719ddc to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/93e859be1f6d4c9ba2fd96b8b9719ddc 2023-10-30 14:53:47,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/11e694fa7a644d5e9a8139f613584f04 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/11e694fa7a644d5e9a8139f613584f04 2023-10-30 14:53:47,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/bb9cd4c4fac64633a71e20667f91d506 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/bb9cd4c4fac64633a71e20667f91d506 2023-10-30 14:53:47,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/f5bcd20256404ebd8a899558dc4db5e2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/f5bcd20256404ebd8a899558dc4db5e2 2023-10-30 14:53:47,553 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/f137da9c74614ed897853c6f4d3d6f34_SeqId_44_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/f137da9c74614ed897853c6f4d3d6f34_SeqId_44_ 2023-10-30 14:53:47,869 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120566ec42ca3b394edb87a80e0554789c26 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120566ec42ca3b394edb87a80e0554789c26 2023-10-30 14:53:47,870 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 14:53:47,900 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6b1f906dde54448283afe413d2de278f first=Optional[r00] last=Optional[r2] 2023-10-30 14:53:47,901 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6b1f906dde54448283afe413d2de278f}] 2023-10-30 14:53:47,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6b1f906dde54448283afe413d2de278f for inclusion in ae3648a2636fe2f7065dcbeb2d18bd58/family1 2023-10-30 14:53:47,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-30 14:53:47,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:53:47,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for ae3648a2636fe2f7065dcbeb2d18bd58: 2023-10-30 14:53:47,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6b1f906dde54448283afe413d2de278f to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyPolicy__9b7uqinc4h3lh6d693g17308ahs1m8i91c69hfnojk3bna449l8lk3lc20hqab2o/family1/6b1f906dde54448283afe413d2de278f 2023-10-30 14:53:47,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyPolicy__9b7uqinc4h3lh6d693g17308ahs1m8i91c69hfnojk3bna449l8lk3lc20hqab2o/family1/6b1f906dde54448283afe413d2de278f as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/5a79ad3c0754480098cbc3cf90f020db_SeqId_47_ 2023-10-30 14:53:47,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyPolicy__9b7uqinc4h3lh6d693g17308ahs1m8i91c69hfnojk3bna449l8lk3lc20hqab2o/family1/6b1f906dde54448283afe413d2de278f into ae3648a2636fe2f7065dcbeb2d18bd58/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/5a79ad3c0754480098cbc3cf90f020db_SeqId_47_ - updating store file list. 2023-10-30 14:53:47,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/5a79ad3c0754480098cbc3cf90f020db_SeqId_47_ into ae3648a2636fe2f7065dcbeb2d18bd58/family1 2023-10-30 14:53:47,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyPolicy__9b7uqinc4h3lh6d693g17308ahs1m8i91c69hfnojk3bna449l8lk3lc20hqab2o/family1/6b1f906dde54448283afe413d2de278f into ae3648a2636fe2f7065dcbeb2d18bd58/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/5a79ad3c0754480098cbc3cf90f020db_SeqId_47_) 2023-10-30 14:53:47,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyPolicy__9b7uqinc4h3lh6d693g17308ahs1m8i91c69hfnojk3bna449l8lk3lc20hqab2o/family1/6b1f906dde54448283afe413d2de278f 2023-10-30 14:53:47,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 14:53:47,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 14:53:47,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(1912): ae3648a2636fe2f7065dcbeb2d18bd58/family1 is initiating minor compaction (all files) 2023-10-30 14:53:47,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1939467f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:53:47,921 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ae3648a2636fe2f7065dcbeb2d18bd58/family1 in testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:53:47,921 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/562fbeb400d44b7db6edfe10e0295391, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/ec4f3071ee3548cb9fef5c9a1d855fa2, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/5a79ad3c0754480098cbc3cf90f020db_SeqId_47_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp, totalSize=337.0 K 2023-10-30 14:53:47,921 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 562fbeb400d44b7db6edfe10e0295391, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878852219 2023-10-30 14:53:47,922 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting ec4f3071ee3548cb9fef5c9a1d855fa2, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621252219 2023-10-30 14:53:47,922 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 5a79ad3c0754480098cbc3cf90f020db_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878852219 2023-10-30 14:53:47,922 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 14:53:47,923 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:47,927 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130d1ba3d7fa5a546c3864f8a6fbe3007f1 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130d1ba3d7fa5a546c3864f8a6fbe3007f1 2023-10-30 14:53:47,931 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201f24526e52f694f80ba5088693ff75cd2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201f24526e52f694f80ba5088693ff75cd2 2023-10-30 14:53:47,932 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512050d484983e36241a6b79218289feaa307 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512050d484983e36241a6b79218289feaa307 2023-10-30 14:53:47,932 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-10-30 14:53:47,933 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-30 14:53:47,933 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 14:53:47,933 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 14:53:47,933 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:53:47,935 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 14:53:47,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.9310 sec 2023-10-30 14:53:47,947 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] throttle.PressureAwareThroughputController(145): ae3648a2636fe2f7065dcbeb2d18bd58#family1#compaction#50 average throughput is 14.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:53:48,028 INFO [Listener at localhost/34621] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=256 (was 246) - Thread LEAK? -, OpenFileDescriptor=622 (was 585) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=379 (was 326) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=2051 (was 2080) 2023-10-30 14:53:48,038 INFO [Listener at localhost/34621] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=256, OpenFileDescriptor=622, MaxFileDescriptor=60000, SystemLoadAverage=379, ProcessCount=168, AvailableMemoryMB=2051 2023-10-30 14:53:48,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 14:53:48,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:48,043 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 14:53:48,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-10-30 14:53:48,044 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 14:53:48,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 14:53:48,045 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780 2023-10-30 14:53:48,046 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780 empty. 2023-10-30 14:53:48,046 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780 2023-10-30 14:53:48,046 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-10-30 14:53:48,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 14:53:48,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 14:53:48,457 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-10-30 14:53:48,459 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => ca132995761ed98f70b5bb299b22d780, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:53:48,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 14:53:48,865 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:53:48,866 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing ca132995761ed98f70b5bb299b22d780, disabling compactions & flushes 2023-10-30 14:53:48,866 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:48,866 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:48,866 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. after waiting 0 ms 2023-10-30 14:53:48,866 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:48,866 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:48,866 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:53:48,868 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 14:53:48,869 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698677628869"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677628869"}]},"ts":"1698677628869"} 2023-10-30 14:53:48,870 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 14:53:48,871 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 14:53:48,871 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677628871"}]},"ts":"1698677628871"} 2023-10-30 14:53:48,872 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-10-30 14:53:48,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ca132995761ed98f70b5bb299b22d780, ASSIGN}] 2023-10-30 14:53:48,876 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ca132995761ed98f70b5bb299b22d780, ASSIGN 2023-10-30 14:53:48,877 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ca132995761ed98f70b5bb299b22d780, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:53:49,028 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=ca132995761ed98f70b5bb299b22d780, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:49,028 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698677629028"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677629028"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677629028"}]},"ts":"1698677629028"} 2023-10-30 14:53:49,030 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure ca132995761ed98f70b5bb299b22d780, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:53:49,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 14:53:49,165 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/.tmp/family1/3d45cfc3bdb44711950208aae071e60a as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/3d45cfc3bdb44711950208aae071e60a 2023-10-30 14:53:49,170 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ae3648a2636fe2f7065dcbeb2d18bd58/family1 of ae3648a2636fe2f7065dcbeb2d18bd58 into 3d45cfc3bdb44711950208aae071e60a(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:53:49,170 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ae3648a2636fe2f7065dcbeb2d18bd58: 2023-10-30 14:53:49,170 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1698677627920; duration=1sec 2023-10-30 14:53:49,170 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:53:49,181 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:49,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:49,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ca132995761ed98f70b5bb299b22d780, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.', STARTKEY => '', ENDKEY => ''} 2023-10-30 14:53:49,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly ca132995761ed98f70b5bb299b22d780 2023-10-30 14:53:49,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:53:49,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ca132995761ed98f70b5bb299b22d780 2023-10-30 14:53:49,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ca132995761ed98f70b5bb299b22d780 2023-10-30 14:53:49,186 INFO [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ca132995761ed98f70b5bb299b22d780 2023-10-30 14:53:49,188 DEBUG [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1 2023-10-30 14:53:49,188 DEBUG [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1 2023-10-30 14:53:49,189 INFO [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca132995761ed98f70b5bb299b22d780 columnFamilyName family1 2023-10-30 14:53:49,190 INFO [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] regionserver.HStore(310): Store=ca132995761ed98f70b5bb299b22d780/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:53:49,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780 2023-10-30 14:53:49,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780 2023-10-30 14:53:49,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ca132995761ed98f70b5bb299b22d780 2023-10-30 14:53:49,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:53:49,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ca132995761ed98f70b5bb299b22d780; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73429389, jitterRate=0.09418316185474396}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 14:53:49,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:53:49,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780., pid=41, masterSystemTime=1698677629181 2023-10-30 14:53:49,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:49,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:49,199 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=ca132995761ed98f70b5bb299b22d780, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:49,199 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698677629199"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677629199"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677629199"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677629199"}]},"ts":"1698677629199"} 2023-10-30 14:53:49,201 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-10-30 14:53:49,201 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure ca132995761ed98f70b5bb299b22d780, server=jenkins-hbase20.apache.org,36359,1698677568317 in 170 msec 2023-10-30 14:53:49,202 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-10-30 14:53:49,202 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ca132995761ed98f70b5bb299b22d780, ASSIGN in 327 msec 2023-10-30 14:53:49,203 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 14:53:49,203 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677629203"}]},"ts":"1698677629203"} 2023-10-30 14:53:49,204 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-10-30 14:53:49,205 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 14:53:49,206 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1640 sec 2023-10-30 14:53:49,224 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/562fbeb400d44b7db6edfe10e0295391, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/ec4f3071ee3548cb9fef5c9a1d855fa2, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/5a79ad3c0754480098cbc3cf90f020db_SeqId_47_] to archive 2023-10-30 14:53:49,225 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:53:49,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/562fbeb400d44b7db6edfe10e0295391 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/562fbeb400d44b7db6edfe10e0295391 2023-10-30 14:53:49,228 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/ec4f3071ee3548cb9fef5c9a1d855fa2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/ec4f3071ee3548cb9fef5c9a1d855fa2 2023-10-30 14:53:49,229 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/5a79ad3c0754480098cbc3cf90f020db_SeqId_47_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/family1/5a79ad3c0754480098cbc3cf90f020db_SeqId_47_ 2023-10-30 14:53:50,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 14:53:50,150 INFO [Listener at localhost/34621] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-10-30 14:53:50,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:50,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:50,178 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:50,178 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:50,178 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 14:53:50,178 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 14:53:50,179 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:50,179 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:50,179 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:50,179 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:50,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:50,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:50,180 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:50,180 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:50,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:50,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:50,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:50,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:50,180 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:50,180 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:50,181 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 14:53:50,181 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:50,181 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 14:53:50,181 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:50,181 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:50,181 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:50,181 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. started... 2023-10-30 14:53:50,182 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca132995761ed98f70b5bb299b22d780 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 14:53:50,605 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e986f14ba6f04aea9c0ec0cb2ed765f5 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130e986f14ba6f04aea9c0ec0cb2ed765f5 2023-10-30 14:53:50,768 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:51,009 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/f7ecf4ed4d5a4cbd9b2c2f778b32c890 2023-10-30 14:53:51,016 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/f7ecf4ed4d5a4cbd9b2c2f778b32c890 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/f7ecf4ed4d5a4cbd9b2c2f778b32c890 2023-10-30 14:53:51,021 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/f7ecf4ed4d5a4cbd9b2c2f778b32c890, entries=1000, sequenceid=5, filesize=191.4 K 2023-10-30 14:53:51,022 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ca132995761ed98f70b5bb299b22d780 in 840ms, sequenceid=5, compaction requested=false 2023-10-30 14:53:51,023 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:53:51,023 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:51,023 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:51,023 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:51,023 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,023 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 14:53:51,023 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 14:53:51,027 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,027 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:51,028 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,028 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:51,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 14:53:51,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ab2729e[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:51,029 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 14:53:51,029 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,030 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,030 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 14:53:51,030 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 14:53:51,030 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:51,030 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,030 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:51,031 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,031 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 14:53:51,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,031 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:51,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:51,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:51,031 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 14:53:51,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:51,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:51,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:51,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:51,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 14:53:51,033 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 14:53:51,033 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:51,033 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:51,033 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,033 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:51,034 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,034 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:51,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:51,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,034 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:51,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:51,034 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:51,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:51,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:51,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,035 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:51,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,036 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:51,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:51,037 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:51,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:51,037 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:51,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 14:53:51,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:51,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:51,037 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:51,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:51,037 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,037 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,037 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,037 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,037 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:51,037 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,037 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:51,037 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,137 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:51,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:51,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:51,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:51,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,146 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:51,146 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:51,146 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 14:53:51,146 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 14:53:51,146 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,146 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,147 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:51,147 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:51,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:51,147 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,147 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:51,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:51,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,148 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,148 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 14:53:51,148 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,148 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 14:53:51,148 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:51,148 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 14:53:51,149 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:51,149 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:51,149 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:51,149 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. started... 2023-10-30 14:53:51,150 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca132995761ed98f70b5bb299b22d780 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 14:53:51,169 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128939f20d143df4e84a5669d89875d2000 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128939f20d143df4e84a5669d89875d2000 2023-10-30 14:53:51,579 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/7a4471249ef44011938933082c950959 2023-10-30 14:53:51,585 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/7a4471249ef44011938933082c950959 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/7a4471249ef44011938933082c950959 2023-10-30 14:53:51,590 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/7a4471249ef44011938933082c950959, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 14:53:51,591 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ca132995761ed98f70b5bb299b22d780 in 441ms, sequenceid=9, compaction requested=false 2023-10-30 14:53:51,591 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:53:51,591 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:51,591 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:51,591 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:51,591 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,591 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 14:53:51,591 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 14:53:51,592 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,592 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:51,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:51,592 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,593 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:51,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:51,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:51,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:51,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 14:53:51,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31ff3081[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:51,594 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 14:53:51,594 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,595 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,595 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 14:53:51,595 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 14:53:51,595 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:51,595 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,595 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:51,596 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,596 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 14:53:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:51,596 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:51,596 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 14:53:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:51,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 14:53:51,598 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 14:53:51,598 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:51,598 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:51,598 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,598 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:51,599 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,599 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:51,600 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:51,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:51,600 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:51,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,601 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:51,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,604 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,604 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,604 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,604 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:51,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 14:53:51,604 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:51,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:51,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:51,604 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:51,604 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:51,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:51,604 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,604 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,604 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:51,604 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,604 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:51,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:51,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:51,705 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:51,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:51,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:51,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:51,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,712 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:51,712 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:51,712 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 14:53:51,712 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 14:53:51,712 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,712 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,713 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:51,713 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:51,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:51,713 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:51,714 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:51,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:51,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,714 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,714 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 14:53:51,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:51,714 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 14:53:51,714 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:51,715 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 14:53:51,715 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:51,715 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:51,715 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:51,715 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. started... 2023-10-30 14:53:51,715 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca132995761ed98f70b5bb299b22d780 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:52,130 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512011e10374d2d634c07af62fa3fb69037b1 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512011e10374d2d634c07af62fa3fb69037b1 2023-10-30 14:53:52,537 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/0db7d578335d4c83b6da915b6512bd4a 2023-10-30 14:53:52,543 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/0db7d578335d4c83b6da915b6512bd4a as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/0db7d578335d4c83b6da915b6512bd4a 2023-10-30 14:53:52,547 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/0db7d578335d4c83b6da915b6512bd4a, entries=1, sequenceid=13, filesize=5.0 K 2023-10-30 14:53:52,548 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ca132995761ed98f70b5bb299b22d780 in 833ms, sequenceid=13, compaction requested=true 2023-10-30 14:53:52,548 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:53:52,548 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:52,548 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:52,548 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:52,548 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:52,548 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 14:53:52,548 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 14:53:52,549 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:52,549 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:52,549 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,550 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:52,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:52,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:52,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:52,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:52,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 14:53:52,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43c07918[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:52,551 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 14:53:52,551 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,552 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,552 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 14:53:52,552 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 14:53:52,552 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:52,552 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:52,552 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:52,553 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:52,553 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 14:53:52,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:52,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:52,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:52,553 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:52,553 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 14:53:52,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:52,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:52,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:52,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 14:53:52,554 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 14:53:52,555 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:52,555 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:52,555 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,555 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:52,555 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,555 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:52,555 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:52,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:52,556 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:52,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,557 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:52,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:52,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:52,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:52,558 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:52,558 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:52,558 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:52,558 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:52,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:52,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 14:53:52,558 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:52,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:52,558 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:52,558 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:52,559 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,559 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,559 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:52,559 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,559 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:52,659 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:52,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:52,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:52,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:52,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,667 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:52,667 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:52,667 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 14:53:52,667 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 14:53:52,668 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,668 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,670 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:52,670 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:52,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:52,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:52,670 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:52,670 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:52,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:52,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,671 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,674 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 14:53:52,675 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:52,675 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 14:53:52,675 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:52,675 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 14:53:52,675 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:52,675 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:52,675 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:52,675 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. started... 2023-10-30 14:53:52,675 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca132995761ed98f70b5bb299b22d780 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:53,093 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c4c532dfa2a34fcaac98031977e67c5e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205c4c532dfa2a34fcaac98031977e67c5e 2023-10-30 14:53:53,499 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/eedcfe0378af46afa81a5f414ccecd17 2023-10-30 14:53:53,504 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/eedcfe0378af46afa81a5f414ccecd17 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/eedcfe0378af46afa81a5f414ccecd17 2023-10-30 14:53:53,508 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/eedcfe0378af46afa81a5f414ccecd17, entries=1, sequenceid=17, filesize=5.0 K 2023-10-30 14:53:53,509 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ca132995761ed98f70b5bb299b22d780 in 834ms, sequenceid=17, compaction requested=true 2023-10-30 14:53:53,509 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:53:53,509 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:53,509 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:53,509 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:53,509 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:53,509 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 14:53:53,509 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 14:53:53,510 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,510 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:53,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:53,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:53,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:53,511 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,511 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:53,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:53,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:53,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:53,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:53,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 14:53:53,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b4c9e32[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:53,513 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 14:53:53,513 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,513 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,514 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 14:53:53,514 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 14:53:53,514 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:53,514 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:53,514 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:53,514 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 14:53:53,514 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:53,514 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:53,515 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 14:53:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:53,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:53,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:53,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:53,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 14:53:53,517 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 14:53:53,517 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:53,517 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:53,517 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,517 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:53,519 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,519 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:53,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,519 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:53,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:53,519 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:53,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:53,520 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:53,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:53,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:53,522 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:53,522 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:53,522 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:53,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:53,522 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:53,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:53,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:53,522 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:53,522 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:53,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:53,523 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:53,523 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:53,523 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:53,523 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,523 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,523 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,623 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:53,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:53,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:53,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:53,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,636 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:53,636 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:53,636 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 14:53:53,636 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 14:53:53,637 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,637 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,640 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:53,640 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:53,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:53,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:53,641 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:53,641 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:53,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:53,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,643 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,644 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 14:53:53,644 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:53,644 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 14:53:53,644 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:53,644 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 14:53:53,644 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:53,644 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:53,644 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:53,645 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. started... 2023-10-30 14:53:53,645 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca132995761ed98f70b5bb299b22d780 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:54,061 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f6506efa2c9f4d0ab9ceb512baca386d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228f6506efa2c9f4d0ab9ceb512baca386d 2023-10-30 14:53:54,467 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/23a47abe97344902b41000a9bdf3360a 2023-10-30 14:53:54,477 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/23a47abe97344902b41000a9bdf3360a as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/23a47abe97344902b41000a9bdf3360a 2023-10-30 14:53:54,482 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/23a47abe97344902b41000a9bdf3360a, entries=1, sequenceid=21, filesize=5.0 K 2023-10-30 14:53:54,483 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ca132995761ed98f70b5bb299b22d780 in 838ms, sequenceid=21, compaction requested=true 2023-10-30 14:53:54,483 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:53:54,483 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:54,484 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:54,484 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:54,484 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:54,484 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 14:53:54,484 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 14:53:54,485 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,485 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:54,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:54,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:54,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:54,485 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,485 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:54,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:54,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:54,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:54,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 14:53:54,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2233347[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:54,487 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 14:53:54,487 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,488 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,488 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 14:53:54,488 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 14:53:54,488 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:54,489 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:54,489 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:54,489 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:54,489 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 14:53:54,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:54,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:54,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:54,489 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:54,490 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 14:53:54,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:54,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:54,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:54,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:54,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:54,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:54,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 14:53:54,492 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 14:53:54,492 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:54,492 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:54,492 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,492 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:54,493 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,493 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:54,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:54,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,493 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:54,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,493 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:54,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:54,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:54,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:54,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:54,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,494 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:54,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:54,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:54,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:54,495 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:54,495 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,495 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,495 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:54,496 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,496 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,496 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,496 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:54,496 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:54,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 14:53:54,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:54,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:54,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:54,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:54,496 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:54,496 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:54,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:54,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:54,496 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:54,596 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:54,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:54,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:54,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:54,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,604 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:54,604 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:54,604 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 14:53:54,604 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 14:53:54,605 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,605 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,606 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:54,606 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:54,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:54,607 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:54,607 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:54,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:54,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,608 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,608 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 14:53:54,608 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:54,609 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 14:53:54,609 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:54,609 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 14:53:54,609 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:54,609 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:54,609 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:54,609 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. started... 2023-10-30 14:53:54,609 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca132995761ed98f70b5bb299b22d780 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:54,628 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e514c0893c554e94ad29375f4d71b971 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231e514c0893c554e94ad29375f4d71b971 2023-10-30 14:53:54,725 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 14:53:55,036 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/37cd061dd048472e999e358d12fd9f65 2023-10-30 14:53:55,049 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/37cd061dd048472e999e358d12fd9f65 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/37cd061dd048472e999e358d12fd9f65 2023-10-30 14:53:55,056 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/37cd061dd048472e999e358d12fd9f65, entries=1, sequenceid=25, filesize=5.0 K 2023-10-30 14:53:55,057 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ca132995761ed98f70b5bb299b22d780 in 448ms, sequenceid=25, compaction requested=true 2023-10-30 14:53:55,057 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:53:55,057 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:55,057 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:55,057 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:55,057 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:55,057 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 14:53:55,057 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 14:53:55,058 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,058 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:55,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:55,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:55,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:55,059 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,059 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:55,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:55,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:55,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:55,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:55,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 14:53:55,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a1070ba[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:55,060 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 14:53:55,060 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,061 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,061 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 14:53:55,061 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 14:53:55,061 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:55,061 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:55,061 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:55,062 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 14:53:55,062 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:55,062 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:55,062 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 14:53:55,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:55,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:55,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:55,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:55,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:55,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:55,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:55,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:55,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:55,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 14:53:55,064 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 14:53:55,064 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:55,064 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:55,064 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,064 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:55,065 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:55,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:55,065 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,065 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:55,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:55,066 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:55,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:55,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:55,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:55,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:55,067 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:55,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:55,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:55,068 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:55,068 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:55,068 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:55,068 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:55,068 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:55,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:55,068 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:55,068 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:55,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:55,068 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,068 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,068 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,068 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:55,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:55,068 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:55,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:55,168 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:55,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:55,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:55,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:55,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,177 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:55,177 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:55,177 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 14:53:55,177 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 14:53:55,178 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,178 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,179 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:55,179 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:55,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:55,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:55,179 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:55,179 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:55,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:55,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,180 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,180 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 14:53:55,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:55,181 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 14:53:55,181 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:55,181 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 14:53:55,181 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:55,181 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:55,181 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:55,181 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. started... 2023-10-30 14:53:55,181 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca132995761ed98f70b5bb299b22d780 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:55,603 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601015002ac6817154642b2df92a4de42c2e2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601015002ac6817154642b2df92a4de42c2e2 2023-10-30 14:53:56,013 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/bf8b816face643389965aa86a6e10ea9 2023-10-30 14:53:56,026 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/bf8b816face643389965aa86a6e10ea9 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/bf8b816face643389965aa86a6e10ea9 2023-10-30 14:53:56,032 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/bf8b816face643389965aa86a6e10ea9, entries=1, sequenceid=29, filesize=5.0 K 2023-10-30 14:53:56,033 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ca132995761ed98f70b5bb299b22d780 in 852ms, sequenceid=29, compaction requested=true 2023-10-30 14:53:56,033 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:53:56,033 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:56,034 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:56,034 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:56,034 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:56,034 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 14:53:56,034 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 14:53:56,036 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:56,036 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:56,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:56,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:56,036 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,036 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:56,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:56,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:56,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:56,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:56,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 14:53:56,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a58c859[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:56,039 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 14:53:56,039 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,048 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,048 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 14:53:56,048 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 14:53:56,048 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:56,048 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:56,048 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:56,052 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:56,052 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 14:53:56,052 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:56,052 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 14:53:56,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:56,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:56,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:56,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:56,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:56,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:56,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:56,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:56,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:56,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 14:53:56,058 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 14:53:56,058 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:56,058 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:56,058 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,058 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:56,065 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,065 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:56,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:56,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,065 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:56,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:56,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:56,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:56,066 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:56,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:56,069 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:56,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:56,073 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:56,073 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,073 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,073 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:56,073 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,073 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,073 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:56,073 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:56,073 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 14:53:56,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:56,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:56,073 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:56,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:56,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:56,074 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:56,074 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:56,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:56,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:56,174 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:56,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:56,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:56,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:56,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,193 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:56,193 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:56,193 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 14:53:56,193 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 14:53:56,194 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,194 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,195 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:56,195 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:56,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:56,195 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:56,195 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:56,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,196 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,196 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 14:53:56,196 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:56,196 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 14:53:56,196 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:56,196 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 14:53:56,196 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:56,196 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:56,196 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:56,196 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. started... 2023-10-30 14:53:56,197 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca132995761ed98f70b5bb299b22d780 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:56,619 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a0072ec35ec143a4b1ef80ad0911f7ca to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a0072ec35ec143a4b1ef80ad0911f7ca 2023-10-30 14:53:57,028 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/afbb5ef677b54f519a3bc7e63c669d69 2023-10-30 14:53:57,039 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/afbb5ef677b54f519a3bc7e63c669d69 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/afbb5ef677b54f519a3bc7e63c669d69 2023-10-30 14:53:57,045 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/afbb5ef677b54f519a3bc7e63c669d69, entries=1, sequenceid=33, filesize=5.0 K 2023-10-30 14:53:57,046 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ca132995761ed98f70b5bb299b22d780 in 849ms, sequenceid=33, compaction requested=true 2023-10-30 14:53:57,046 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:53:57,046 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:57,046 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:57,046 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:57,046 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:57,046 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 14:53:57,046 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 14:53:57,048 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,048 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:57,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:57,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:57,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:57,048 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,048 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:57,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:57,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:57,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:57,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:57,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 14:53:57,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25ca7a2e[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:57,050 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 14:53:57,050 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,051 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,051 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 14:53:57,051 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 14:53:57,051 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:57,052 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:57,052 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:57,052 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 14:53:57,053 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:57,053 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:57,053 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 14:53:57,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:57,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:57,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:57,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:57,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:57,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:57,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:57,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:57,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:57,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 14:53:57,055 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 14:53:57,055 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:57,055 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:57,055 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,055 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:57,056 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,056 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:57,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:57,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,056 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:57,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:57,056 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:57,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:57,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:57,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:57,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,057 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:57,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:57,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:57,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:57,059 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:57,059 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:57,059 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:57,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:57,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:57,059 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:57,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:57,059 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:57,059 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,059 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:57,059 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:57,059 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 14:53:57,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:57,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:57,059 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:57,059 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,059 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,059 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,159 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:57,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:57,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:57,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:57,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,173 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:57,173 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:57,173 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 14:53:57,173 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 14:53:57,174 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,174 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,175 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:57,176 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:57,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:57,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:57,176 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:57,176 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:57,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:57,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,178 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,178 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 14:53:57,178 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:57,179 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 14:53:57,179 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:57,179 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 14:53:57,179 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:57,179 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:57,179 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:57,179 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. started... 2023-10-30 14:53:57,179 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca132995761ed98f70b5bb299b22d780 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:57,610 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509070a1d920aa92a476f9d9836d544c18dca to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201509070a1d920aa92a476f9d9836d544c18dca 2023-10-30 14:53:58,021 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/d9ed0246a712449c87caff23d22465ab 2023-10-30 14:53:58,031 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/d9ed0246a712449c87caff23d22465ab as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/d9ed0246a712449c87caff23d22465ab 2023-10-30 14:53:58,037 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/d9ed0246a712449c87caff23d22465ab, entries=1, sequenceid=37, filesize=5.0 K 2023-10-30 14:53:58,038 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ca132995761ed98f70b5bb299b22d780 in 859ms, sequenceid=37, compaction requested=true 2023-10-30 14:53:58,039 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:53:58,039 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:58,039 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:58,039 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:58,039 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:58,039 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 14:53:58,039 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 14:53:58,040 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,040 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:58,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:58,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:58,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:58,041 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,041 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:58,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:58,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 14:53:58,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e68ccdb[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:58,044 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 14:53:58,044 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,045 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,045 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 14:53:58,045 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 14:53:58,045 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:58,045 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:58,045 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:58,046 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 14:53:58,046 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:58,046 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:58,046 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 14:53:58,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:58,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:58,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:58,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:58,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:58,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:58,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:58,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:58,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:58,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 14:53:58,049 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 14:53:58,049 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:58,049 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:58,049 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,049 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:58,050 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,050 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:58,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:58,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,050 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:58,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:58,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:58,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:58,051 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:58,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:58,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,052 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:58,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:58,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:58,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:58,054 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:58,054 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:58,054 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:58,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 14:53:58,054 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:58,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:58,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:58,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:58,054 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:58,054 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,054 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:58,054 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,054 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:58,054 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:58,055 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:58,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:58,054 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,155 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:58,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:58,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:53:58,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 14:53:58,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,169 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:58,169 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:58,169 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 14:53:58,169 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 14:53:58,170 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,170 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,171 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:58,171 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:58,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:58,171 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:58,171 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:53:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:53:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,172 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,173 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 14:53:58,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:58,173 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 14:53:58,173 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:53:58,173 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 14:53:58,173 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:53:58,173 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:53:58,173 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:58,173 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. started... 2023-10-30 14:53:58,173 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca132995761ed98f70b5bb299b22d780 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:53:58,597 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e76dd920624c477bbc9b2eea438204c3 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120e76dd920624c477bbc9b2eea438204c3 2023-10-30 14:53:59,006 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/3a09ccce8200491bba69e824828a310e 2023-10-30 14:53:59,018 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/3a09ccce8200491bba69e824828a310e as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/3a09ccce8200491bba69e824828a310e 2023-10-30 14:53:59,025 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/3a09ccce8200491bba69e824828a310e, entries=1, sequenceid=41, filesize=5.0 K 2023-10-30 14:53:59,026 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ca132995761ed98f70b5bb299b22d780 in 853ms, sequenceid=41, compaction requested=true 2023-10-30 14:53:59,027 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:53:59,027 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:53:59,027 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:53:59,027 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:53:59,027 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:59,027 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 14:53:59,027 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 14:53:59,029 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:59,029 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:59,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:59,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:59,029 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,029 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:53:59,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:59,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:59,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:59,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:59,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 14:53:59,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7734fe0c[Count = 0] remaining members to acquire global barrier 2023-10-30 14:53:59,032 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 14:53:59,033 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,033 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,034 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 14:53:59,034 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 14:53:59,034 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:53:59,034 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:59,034 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:53:59,035 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:59,035 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 14:53:59,035 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:59,035 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 14:53:59,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:59,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:59,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:59,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:59,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:59,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:59,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:59,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:59,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:53:59,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 14:53:59,039 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 14:53:59,039 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:53:59,039 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:53:59,039 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,039 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:53:59,048 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,048 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:53:59,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:53:59,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,048 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:59,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:53:59,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:59,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:59,049 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:59,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:53:59,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:59,049 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:59,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:53:59,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:59,051 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:59,051 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,051 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,051 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:53:59,051 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,051 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,051 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 14:53:59,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:53:59,051 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:53:59,052 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 14:53:59,052 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:53:59,052 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:53:59,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:53:59,052 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:53:59,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:53:59,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:53:59,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:53:59,152 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:53:59,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:53:59,154 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43911] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:53:59,155 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 14:53:59,156 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 14:53:59,157 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:53:59,157 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698678239157 2023-10-30 14:53:59,159 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 14:53:59,160 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-30 14:53:59,160 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 14:53:59,161 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] zookeeper.ReadOnlyZKClient(139): Connect 0x2d7a9173 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:53:59,165 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ae3c743, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:53:59,165 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:00,005 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ad998687de97411a8eb5cb237ec79d56 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103ad998687de97411a8eb5cb237ec79d56 2023-10-30 14:54:00,006 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 14:54:00,017 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:54:00,018 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:54:00,025 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 14:54:00,027 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44558, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 14:54:00,037 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/dca3a377c53248608e52a77db4d75215 first=Optional[r3] last=Optional[r6] 2023-10-30 14:54:00,038 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/dca3a377c53248608e52a77db4d75215}] 2023-10-30 14:54:00,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/dca3a377c53248608e52a77db4d75215 for inclusion in ca132995761ed98f70b5bb299b22d780/family1 2023-10-30 14:54:00,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-30 14:54:00,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:54:00,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:54:00,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/dca3a377c53248608e52a77db4d75215 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__44vtnq77ndmb8ljm26gc84ogjdcetjvmllil51dbmheo57fqvlglatv3m1b8uvs0/family1/dca3a377c53248608e52a77db4d75215 2023-10-30 14:54:00,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__44vtnq77ndmb8ljm26gc84ogjdcetjvmllil51dbmheo57fqvlglatv3m1b8uvs0/family1/dca3a377c53248608e52a77db4d75215 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/85a85db287d740de8a70100c3c2f9f1a_SeqId_44_ 2023-10-30 14:54:00,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__44vtnq77ndmb8ljm26gc84ogjdcetjvmllil51dbmheo57fqvlglatv3m1b8uvs0/family1/dca3a377c53248608e52a77db4d75215 into ca132995761ed98f70b5bb299b22d780/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/85a85db287d740de8a70100c3c2f9f1a_SeqId_44_ - updating store file list. 2023-10-30 14:54:00,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/85a85db287d740de8a70100c3c2f9f1a_SeqId_44_ into ca132995761ed98f70b5bb299b22d780/family1 2023-10-30 14:54:00,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__44vtnq77ndmb8ljm26gc84ogjdcetjvmllil51dbmheo57fqvlglatv3m1b8uvs0/family1/dca3a377c53248608e52a77db4d75215 into ca132995761ed98f70b5bb299b22d780/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/85a85db287d740de8a70100c3c2f9f1a_SeqId_44_) 2023-10-30 14:54:00,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__44vtnq77ndmb8ljm26gc84ogjdcetjvmllil51dbmheo57fqvlglatv3m1b8uvs0/family1/dca3a377c53248608e52a77db4d75215 2023-10-30 14:54:00,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 14:54:00,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 14:54:00,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(1912): ca132995761ed98f70b5bb299b22d780/family1 is initiating minor compaction 2023-10-30 14:54:00,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@f5b576; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:54:00,060 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ca132995761ed98f70b5bb299b22d780/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:54:00,060 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/7a4471249ef44011938933082c950959, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/0db7d578335d4c83b6da915b6512bd4a, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/eedcfe0378af46afa81a5f414ccecd17, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/23a47abe97344902b41000a9bdf3360a, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/37cd061dd048472e999e358d12fd9f65, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/bf8b816face643389965aa86a6e10ea9, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/afbb5ef677b54f519a3bc7e63c669d69, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/d9ed0246a712449c87caff23d22465ab, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/3a09ccce8200491bba69e824828a310e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/85a85db287d740de8a70100c3c2f9f1a_SeqId_44_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp, totalSize=50.4 K 2023-10-30 14:54:00,060 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 7a4471249ef44011938933082c950959, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 14:54:00,060 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 0db7d578335d4c83b6da915b6512bd4a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 14:54:00,060 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting eedcfe0378af46afa81a5f414ccecd17, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 14:54:00,061 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 23a47abe97344902b41000a9bdf3360a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 14:54:00,061 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 37cd061dd048472e999e358d12fd9f65, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 14:54:00,061 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting bf8b816face643389965aa86a6e10ea9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 14:54:00,061 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting afbb5ef677b54f519a3bc7e63c669d69, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 14:54:00,061 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting d9ed0246a712449c87caff23d22465ab, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 14:54:00,061 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 3a09ccce8200491bba69e824828a310e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 14:54:00,061 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 85a85db287d740de8a70100c3c2f9f1a_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 14:54:00,062 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 14:54:00,063 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:00,064 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228f6506efa2c9f4d0ab9ceb512baca386d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228f6506efa2c9f4d0ab9ceb512baca386d 2023-10-30 14:54:00,065 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231e514c0893c554e94ad29375f4d71b971 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231e514c0893c554e94ad29375f4d71b971 2023-10-30 14:54:00,066 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601015002ac6817154642b2df92a4de42c2e2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601015002ac6817154642b2df92a4de42c2e2 2023-10-30 14:54:00,067 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a0072ec35ec143a4b1ef80ad0911f7ca to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a0072ec35ec143a4b1ef80ad0911f7ca 2023-10-30 14:54:00,068 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-10-30 14:54:00,068 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-30 14:54:00,068 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:00,068 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:00,068 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:00,068 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:00,069 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:00,069 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:00,069 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:00,069 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:00,105 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] throttle.PressureAwareThroughputController(145): ca132995761ed98f70b5bb299b22d780#family1#compaction#61 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:54:00,937 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fd79ca27e03e4100a231bb961cd91e14 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205fd79ca27e03e4100a231bb961cd91e14 2023-10-30 14:54:00,938 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/c0606ae9780b4d0ea69526cfa2945add as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/c0606ae9780b4d0ea69526cfa2945add 2023-10-30 14:54:00,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 14:54:00,943 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ca132995761ed98f70b5bb299b22d780/family1 of ca132995761ed98f70b5bb299b22d780 into c0606ae9780b4d0ea69526cfa2945add(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:54:00,944 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:54:00,944 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698677640060; duration=0sec 2023-10-30 14:54:00,944 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:54:00,963 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/473a870fc9084334a75b31fc060f2336 first=Optional[r00] last=Optional[r2] 2023-10-30 14:54:00,964 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/473a870fc9084334a75b31fc060f2336}] 2023-10-30 14:54:00,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/473a870fc9084334a75b31fc060f2336 for inclusion in ca132995761ed98f70b5bb299b22d780/family1 2023-10-30 14:54:00,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-30 14:54:00,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:54:00,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:54:00,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/473a870fc9084334a75b31fc060f2336 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lthv84jjs1lm4vsg0aahhfkvcf8rridn6fve8tjnt1705vam726vigudsurgg3c2/family1/473a870fc9084334a75b31fc060f2336 2023-10-30 14:54:00,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lthv84jjs1lm4vsg0aahhfkvcf8rridn6fve8tjnt1705vam726vigudsurgg3c2/family1/473a870fc9084334a75b31fc060f2336 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/2b9835713fee48e0a9aaa48a9048e375_SeqId_47_ 2023-10-30 14:54:00,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lthv84jjs1lm4vsg0aahhfkvcf8rridn6fve8tjnt1705vam726vigudsurgg3c2/family1/473a870fc9084334a75b31fc060f2336 into ca132995761ed98f70b5bb299b22d780/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/2b9835713fee48e0a9aaa48a9048e375_SeqId_47_ - updating store file list. 2023-10-30 14:54:00,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/2b9835713fee48e0a9aaa48a9048e375_SeqId_47_ into ca132995761ed98f70b5bb299b22d780/family1 2023-10-30 14:54:00,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lthv84jjs1lm4vsg0aahhfkvcf8rridn6fve8tjnt1705vam726vigudsurgg3c2/family1/473a870fc9084334a75b31fc060f2336 into ca132995761ed98f70b5bb299b22d780/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/2b9835713fee48e0a9aaa48a9048e375_SeqId_47_) 2023-10-30 14:54:00,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lthv84jjs1lm4vsg0aahhfkvcf8rridn6fve8tjnt1705vam726vigudsurgg3c2/family1/473a870fc9084334a75b31fc060f2336 2023-10-30 14:54:00,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 14:54:00,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 14:54:00,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(1912): ca132995761ed98f70b5bb299b22d780/family1 is initiating minor compaction (all files) 2023-10-30 14:54:00,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@191f278; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:54:00,979 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ca132995761ed98f70b5bb299b22d780/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:54:00,979 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/f7ecf4ed4d5a4cbd9b2c2f778b32c890, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/c0606ae9780b4d0ea69526cfa2945add, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/2b9835713fee48e0a9aaa48a9048e375_SeqId_47_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp, totalSize=390.1 K 2023-10-30 14:54:00,980 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting f7ecf4ed4d5a4cbd9b2c2f778b32c890, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878852219 2023-10-30 14:54:00,980 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting c0606ae9780b4d0ea69526cfa2945add, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621252219 2023-10-30 14:54:00,981 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 2b9835713fee48e0a9aaa48a9048e375_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878852219 2023-10-30 14:54:00,981 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 14:54:00,982 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:00,983 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130e986f14ba6f04aea9c0ec0cb2ed765f5 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130e986f14ba6f04aea9c0ec0cb2ed765f5 2023-10-30 14:54:00,984 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512011e10374d2d634c07af62fa3fb69037b1 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512011e10374d2d634c07af62fa3fb69037b1 2023-10-30 14:54:00,987 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205c4c532dfa2a34fcaac98031977e67c5e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205c4c532dfa2a34fcaac98031977e67c5e 2023-10-30 14:54:00,987 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-10-30 14:54:00,987 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-30 14:54:00,988 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:00,988 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 14:54:00,988 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:54:00,989 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 14:54:00,991 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8350 sec 2023-10-30 14:54:00,997 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] throttle.PressureAwareThroughputController(145): ca132995761ed98f70b5bb299b22d780#family1#compaction#62 average throughput is 22.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:54:01,035 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/7a4471249ef44011938933082c950959, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/0db7d578335d4c83b6da915b6512bd4a, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/eedcfe0378af46afa81a5f414ccecd17, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/23a47abe97344902b41000a9bdf3360a, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/37cd061dd048472e999e358d12fd9f65, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/bf8b816face643389965aa86a6e10ea9, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/afbb5ef677b54f519a3bc7e63c669d69, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/d9ed0246a712449c87caff23d22465ab, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/3a09ccce8200491bba69e824828a310e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/85a85db287d740de8a70100c3c2f9f1a_SeqId_44_] to archive 2023-10-30 14:54:01,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:01,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/7a4471249ef44011938933082c950959 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/7a4471249ef44011938933082c950959 2023-10-30 14:54:01,041 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/0db7d578335d4c83b6da915b6512bd4a to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/0db7d578335d4c83b6da915b6512bd4a 2023-10-30 14:54:01,042 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/eedcfe0378af46afa81a5f414ccecd17 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/eedcfe0378af46afa81a5f414ccecd17 2023-10-30 14:54:01,044 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/23a47abe97344902b41000a9bdf3360a to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/23a47abe97344902b41000a9bdf3360a 2023-10-30 14:54:01,045 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/37cd061dd048472e999e358d12fd9f65 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/37cd061dd048472e999e358d12fd9f65 2023-10-30 14:54:01,047 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/bf8b816face643389965aa86a6e10ea9 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/bf8b816face643389965aa86a6e10ea9 2023-10-30 14:54:01,049 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/afbb5ef677b54f519a3bc7e63c669d69 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/afbb5ef677b54f519a3bc7e63c669d69 2023-10-30 14:54:01,050 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/d9ed0246a712449c87caff23d22465ab to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/d9ed0246a712449c87caff23d22465ab 2023-10-30 14:54:01,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/3a09ccce8200491bba69e824828a310e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/3a09ccce8200491bba69e824828a310e 2023-10-30 14:54:01,052 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/85a85db287d740de8a70100c3c2f9f1a_SeqId_44_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/85a85db287d740de8a70100c3c2f9f1a_SeqId_44_ 2023-10-30 14:54:01,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-30 14:54:01,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:54:01,089 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-30 14:54:01,090 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-10-30 14:54:01,090 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-30 14:54:01,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-10-30 14:54:01,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ca132995761ed98f70b5bb299b22d780, REOPEN/MOVE}] 2023-10-30 14:54:01,096 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ca132995761ed98f70b5bb299b22d780, REOPEN/MOVE 2023-10-30 14:54:01,098 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=ca132995761ed98f70b5bb299b22d780, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:01,098 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698677641098"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677641098"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677641098"}]},"ts":"1698677641098"} 2023-10-30 14:54:01,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure ca132995761ed98f70b5bb299b22d780, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:01,251 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:01,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:01,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ca132995761ed98f70b5bb299b22d780, disabling compactions & flushes 2023-10-30 14:54:01,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:54:02,238 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/.tmp/family1/3d78d00309d2417cb5555cdb01cf506f as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/3d78d00309d2417cb5555cdb01cf506f 2023-10-30 14:54:02,246 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ca132995761ed98f70b5bb299b22d780/family1 of ca132995761ed98f70b5bb299b22d780 into 3d78d00309d2417cb5555cdb01cf506f(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:54:02,246 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:54:02,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:54:02,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:54:02,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. after waiting 0 ms 2023-10-30 14:54:02,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:54:02,246 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1698677640979; duration=1sec 2023-10-30 14:54:02,246 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:54:02,247 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/f7ecf4ed4d5a4cbd9b2c2f778b32c890, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/c0606ae9780b4d0ea69526cfa2945add, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/2b9835713fee48e0a9aaa48a9048e375_SeqId_47_] to archive 2023-10-30 14:54:02,248 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:02,251 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/f7ecf4ed4d5a4cbd9b2c2f778b32c890 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/f7ecf4ed4d5a4cbd9b2c2f778b32c890 2023-10-30 14:54:02,252 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/c0606ae9780b4d0ea69526cfa2945add to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/c0606ae9780b4d0ea69526cfa2945add 2023-10-30 14:54:02,254 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/2b9835713fee48e0a9aaa48a9048e375_SeqId_47_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/2b9835713fee48e0a9aaa48a9048e375_SeqId_47_ 2023-10-30 14:54:02,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-30 14:54:02,260 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:54:02,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:54:02,260 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: ca132995761ed98f70b5bb299b22d780 to self. 2023-10-30 14:54:02,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:02,262 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=ca132995761ed98f70b5bb299b22d780, regionState=CLOSED 2023-10-30 14:54:02,262 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698677642262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677642262"}]},"ts":"1698677642262"} 2023-10-30 14:54:02,265 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-10-30 14:54:02,265 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure ca132995761ed98f70b5bb299b22d780, server=jenkins-hbase20.apache.org,36359,1698677568317 in 1.1650 sec 2023-10-30 14:54:02,265 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ca132995761ed98f70b5bb299b22d780, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=true 2023-10-30 14:54:02,416 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=ca132995761ed98f70b5bb299b22d780, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:02,416 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698677642416"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677642416"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677642416"}]},"ts":"1698677642416"} 2023-10-30 14:54:02,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure ca132995761ed98f70b5bb299b22d780, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:02,569 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:02,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:54:02,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ca132995761ed98f70b5bb299b22d780, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.', STARTKEY => '', ENDKEY => ''} 2023-10-30 14:54:02,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:02,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:02,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:02,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:02,574 INFO [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:02,575 DEBUG [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1 2023-10-30 14:54:02,575 DEBUG [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1 2023-10-30 14:54:02,575 INFO [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca132995761ed98f70b5bb299b22d780 columnFamilyName family1 2023-10-30 14:54:02,580 DEBUG [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/3d78d00309d2417cb5555cdb01cf506f 2023-10-30 14:54:02,580 INFO [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] regionserver.HStore(310): Store=ca132995761ed98f70b5bb299b22d780/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:02,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:02,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:02,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:02,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ca132995761ed98f70b5bb299b22d780; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73898883, jitterRate=0.10117916762828827}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 14:54:02,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:54:02,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780., pid=47, masterSystemTime=1698677642569 2023-10-30 14:54:02,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:54:02,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:54:02,589 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=ca132995761ed98f70b5bb299b22d780, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:02,589 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698677642589"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677642589"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677642589"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677642589"}]},"ts":"1698677642589"} 2023-10-30 14:54:02,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-10-30 14:54:02,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure ca132995761ed98f70b5bb299b22d780, server=jenkins-hbase20.apache.org,36359,1698677568317 in 173 msec 2023-10-30 14:54:02,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-10-30 14:54:02,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ca132995761ed98f70b5bb299b22d780, REOPEN/MOVE in 1.4970 sec 2023-10-30 14:54:02,595 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-10-30 14:54:02,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5020 sec 2023-10-30 14:54:02,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5190 sec 2023-10-30 14:54:02,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-10-30 14:54:02,600 INFO [Listener at localhost/34621] compactions.TestMobCompactor(278): alter status finished 2023-10-30 14:54:02,600 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43911] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:54:02,602 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 14:54:02,602 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 14:54:02,603 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:54:02,603 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698678242603 2023-10-30 14:54:02,604 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 14:54:02,605 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-30 14:54:02,605 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 14:54:02,607 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] zookeeper.ReadOnlyZKClient(139): Connect 0x0da6e888 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:54:02,610 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59abefa0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:54:02,611 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:02,611 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:02,611 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:02,611 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:02,611 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:03,441 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112828cbd15769284fc2939ffbbc8901759c to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112828cbd15769284fc2939ffbbc8901759c 2023-10-30 14:54:03,442 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 14:54:03,453 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:54:03,454 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:54:03,460 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 14:54:03,462 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 14:54:03,472 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6cb4003e78ec4b4e9a26120a9cb60bb1 first=Optional[r05] last=Optional[r8] 2023-10-30 14:54:03,472 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=51 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6cb4003e78ec4b4e9a26120a9cb60bb1}] 2023-10-30 14:54:03,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6cb4003e78ec4b4e9a26120a9cb60bb1 for inclusion in ca132995761ed98f70b5bb299b22d780/family1 2023-10-30 14:54:03,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-30 14:54:03,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:54:03,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:54:03,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6cb4003e78ec4b4e9a26120a9cb60bb1 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__j375uc9to534on0apvlq02ud1sbm9qoj77n7geqi81apt4b8a98kqqu25ruqtg2i/family1/6cb4003e78ec4b4e9a26120a9cb60bb1 2023-10-30 14:54:03,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__j375uc9to534on0apvlq02ud1sbm9qoj77n7geqi81apt4b8a98kqqu25ruqtg2i/family1/6cb4003e78ec4b4e9a26120a9cb60bb1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/1bbb2678033a47b8bd6c7c9f57102e03_SeqId_53_ 2023-10-30 14:54:03,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__j375uc9to534on0apvlq02ud1sbm9qoj77n7geqi81apt4b8a98kqqu25ruqtg2i/family1/6cb4003e78ec4b4e9a26120a9cb60bb1 into ca132995761ed98f70b5bb299b22d780/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/1bbb2678033a47b8bd6c7c9f57102e03_SeqId_53_ - updating store file list. 2023-10-30 14:54:03,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/1bbb2678033a47b8bd6c7c9f57102e03_SeqId_53_ into ca132995761ed98f70b5bb299b22d780/family1 2023-10-30 14:54:03,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__j375uc9to534on0apvlq02ud1sbm9qoj77n7geqi81apt4b8a98kqqu25ruqtg2i/family1/6cb4003e78ec4b4e9a26120a9cb60bb1 into ca132995761ed98f70b5bb299b22d780/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/1bbb2678033a47b8bd6c7c9f57102e03_SeqId_53_) 2023-10-30 14:54:03,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__j375uc9to534on0apvlq02ud1sbm9qoj77n7geqi81apt4b8a98kqqu25ruqtg2i/family1/6cb4003e78ec4b4e9a26120a9cb60bb1 2023-10-30 14:54:03,493 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 14:54:03,493 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:03,495 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120e76dd920624c477bbc9b2eea438204c3 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120e76dd920624c477bbc9b2eea438204c3 2023-10-30 14:54:03,496 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128939f20d143df4e84a5669d89875d2000 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128939f20d143df4e84a5669d89875d2000 2023-10-30 14:54:03,496 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-10-30 14:54:03,496 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-30 14:54:03,497 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:03,497 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:03,497 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:03,497 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 14:54:03,497 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:54:03,498 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 14:54:03,500 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 897 msec 2023-10-30 14:54:03,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 14:54:03,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:54:03,585 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-10-30 14:54:03,586 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-30 14:54:03,586 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-10-30 14:54:03,588 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-10-30 14:54:03,591 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ca132995761ed98f70b5bb299b22d780, REOPEN/MOVE}] 2023-10-30 14:54:03,591 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ca132995761ed98f70b5bb299b22d780, REOPEN/MOVE 2023-10-30 14:54:03,592 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=ca132995761ed98f70b5bb299b22d780, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:03,592 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698677643592"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677643592"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677643592"}]},"ts":"1698677643592"} 2023-10-30 14:54:03,594 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure ca132995761ed98f70b5bb299b22d780, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:03,745 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:03,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:03,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ca132995761ed98f70b5bb299b22d780, disabling compactions & flushes 2023-10-30 14:54:03,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:54:03,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:54:03,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. after waiting 0 ms 2023-10-30 14:54:03,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:54:03,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-30 14:54:03,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:54:03,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:54:03,754 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: ca132995761ed98f70b5bb299b22d780 to self. 2023-10-30 14:54:03,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:03,756 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=ca132995761ed98f70b5bb299b22d780, regionState=CLOSED 2023-10-30 14:54:03,757 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698677643756"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677643756"}]},"ts":"1698677643756"} 2023-10-30 14:54:03,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-10-30 14:54:03,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure ca132995761ed98f70b5bb299b22d780, server=jenkins-hbase20.apache.org,36359,1698677568317 in 164 msec 2023-10-30 14:54:03,761 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ca132995761ed98f70b5bb299b22d780, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=true 2023-10-30 14:54:03,912 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=ca132995761ed98f70b5bb299b22d780, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:03,912 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698677643912"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677643912"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677643912"}]},"ts":"1698677643912"} 2023-10-30 14:54:03,914 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure ca132995761ed98f70b5bb299b22d780, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:04,065 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:04,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:54:04,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ca132995761ed98f70b5bb299b22d780, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.', STARTKEY => '', ENDKEY => ''} 2023-10-30 14:54:04,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:04,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:04,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:04,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:04,071 INFO [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:04,072 DEBUG [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1 2023-10-30 14:54:04,072 DEBUG [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1 2023-10-30 14:54:04,072 INFO [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca132995761ed98f70b5bb299b22d780 columnFamilyName family1 2023-10-30 14:54:04,077 DEBUG [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/1bbb2678033a47b8bd6c7c9f57102e03_SeqId_53_ 2023-10-30 14:54:04,080 DEBUG [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/family1/3d78d00309d2417cb5555cdb01cf506f 2023-10-30 14:54:04,080 INFO [StoreOpener-ca132995761ed98f70b5bb299b22d780-1] regionserver.HStore(310): Store=ca132995761ed98f70b5bb299b22d780/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:04,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:04,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:04,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ca132995761ed98f70b5bb299b22d780 2023-10-30 14:54:04,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ca132995761ed98f70b5bb299b22d780; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75330429, jitterRate=0.1225108653306961}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 14:54:04,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:54:04,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780., pid=53, masterSystemTime=1698677644065 2023-10-30 14:54:04,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:54:04,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:54:04,088 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=ca132995761ed98f70b5bb299b22d780, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:04,089 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698677644088"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677644088"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677644088"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677644088"}]},"ts":"1698677644088"} 2023-10-30 14:54:04,092 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-30 14:54:04,092 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure ca132995761ed98f70b5bb299b22d780, server=jenkins-hbase20.apache.org,36359,1698677568317 in 176 msec 2023-10-30 14:54:04,093 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-10-30 14:54:04,093 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ca132995761ed98f70b5bb299b22d780, REOPEN/MOVE in 501 msec 2023-10-30 14:54:04,096 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-10-30 14:54:04,096 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 506 msec 2023-10-30 14:54:04,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 528 msec 2023-10-30 14:54:04,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-10-30 14:54:04,101 INFO [Listener at localhost/34621] compactions.TestMobCompactor(278): alter status finished 2023-10-30 14:54:04,102 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43911] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 14:54:04,103 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 14:54:04,104 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 14:54:04,105 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698678244105 2023-10-30 14:54:04,105 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:54:04,106 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 14:54:04,106 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-30 14:54:04,106 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 14:54:04,107 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] zookeeper.ReadOnlyZKClient(139): Connect 0x00ca2246 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:54:04,111 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69a0b10, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:54:04,111 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:04,111 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:04,111 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:04,111 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:04,111 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:04,111 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:04,111 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:04,111 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 14:54:04,111 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 14:54:04,111 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:54:04,113 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 14:54:04,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-10-30 14:54:04,169 INFO [Listener at localhost/34621] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=250 (was 256), OpenFileDescriptor=631 (was 622) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=369 (was 379), ProcessCount=169 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=1706 (was 2051) 2023-10-30 14:54:04,180 INFO [Listener at localhost/34621] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=250, OpenFileDescriptor=631, MaxFileDescriptor=60000, SystemLoadAverage=369, ProcessCount=169, AvailableMemoryMB=1706 2023-10-30 14:54:04,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 14:54:04,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:04,185 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 14:54:04,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-10-30 14:54:04,185 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 14:54:04,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-30 14:54:04,186 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392 2023-10-30 14:54:04,187 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392 empty. 2023-10-30 14:54:04,188 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392 2023-10-30 14:54:04,188 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-10-30 14:54:04,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-30 14:54:04,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-30 14:54:04,595 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-10-30 14:54:04,596 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8461785ef16c68760c326406dffef392, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:54:04,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-30 14:54:05,003 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:05,003 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 8461785ef16c68760c326406dffef392, disabling compactions & flushes 2023-10-30 14:54:05,003 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:05,004 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:05,004 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. after waiting 0 ms 2023-10-30 14:54:05,004 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:05,004 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:05,004 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:05,006 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 14:54:05,007 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698677645007"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677645007"}]},"ts":"1698677645007"} 2023-10-30 14:54:05,009 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 14:54:05,009 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 14:54:05,009 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677645009"}]},"ts":"1698677645009"} 2023-10-30 14:54:05,011 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-10-30 14:54:05,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8461785ef16c68760c326406dffef392, ASSIGN}] 2023-10-30 14:54:05,014 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8461785ef16c68760c326406dffef392, ASSIGN 2023-10-30 14:54:05,016 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8461785ef16c68760c326406dffef392, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:54:05,167 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=8461785ef16c68760c326406dffef392, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:05,167 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698677645167"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677645167"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677645167"}]},"ts":"1698677645167"} 2023-10-30 14:54:05,169 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 8461785ef16c68760c326406dffef392, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:05,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-30 14:54:05,320 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:05,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:05,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8461785ef16c68760c326406dffef392, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.', STARTKEY => '', ENDKEY => ''} 2023-10-30 14:54:05,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 8461785ef16c68760c326406dffef392 2023-10-30 14:54:05,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:05,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 8461785ef16c68760c326406dffef392 2023-10-30 14:54:05,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 8461785ef16c68760c326406dffef392 2023-10-30 14:54:05,326 INFO [StoreOpener-8461785ef16c68760c326406dffef392-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8461785ef16c68760c326406dffef392 2023-10-30 14:54:05,328 DEBUG [StoreOpener-8461785ef16c68760c326406dffef392-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1 2023-10-30 14:54:05,328 DEBUG [StoreOpener-8461785ef16c68760c326406dffef392-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1 2023-10-30 14:54:05,328 INFO [StoreOpener-8461785ef16c68760c326406dffef392-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8461785ef16c68760c326406dffef392 columnFamilyName family1 2023-10-30 14:54:05,330 INFO [StoreOpener-8461785ef16c68760c326406dffef392-1] regionserver.HStore(310): Store=8461785ef16c68760c326406dffef392/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:05,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392 2023-10-30 14:54:05,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392 2023-10-30 14:54:05,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 8461785ef16c68760c326406dffef392 2023-10-30 14:54:05,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:54:05,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 8461785ef16c68760c326406dffef392; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64542155, jitterRate=-0.038246944546699524}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 14:54:05,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:05,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392., pid=57, masterSystemTime=1698677645320 2023-10-30 14:54:05,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:05,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:05,340 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=8461785ef16c68760c326406dffef392, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:05,341 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698677645340"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677645340"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677645340"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677645340"}]},"ts":"1698677645340"} 2023-10-30 14:54:05,344 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-10-30 14:54:05,344 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 8461785ef16c68760c326406dffef392, server=jenkins-hbase20.apache.org,36359,1698677568317 in 173 msec 2023-10-30 14:54:05,345 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-10-30 14:54:05,345 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8461785ef16c68760c326406dffef392, ASSIGN in 332 msec 2023-10-30 14:54:05,346 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 14:54:05,346 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677645346"}]},"ts":"1698677645346"} 2023-10-30 14:54:05,347 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-10-30 14:54:05,349 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 14:54:05,350 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1670 sec 2023-10-30 14:54:06,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-30 14:54:06,292 INFO [Listener at localhost/34621] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-10-30 14:54:06,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:06,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:06,313 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:06,313 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:06,313 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 14:54:06,313 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 14:54:06,313 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:06,313 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:06,314 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:06,314 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:06,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:06,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:06,314 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:06,314 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:06,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:06,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:06,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:06,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:06,315 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:06,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:06,315 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 14:54:06,315 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:06,315 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 14:54:06,318 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:54:06,318 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:06,318 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:06,318 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. started... 2023-10-30 14:54:06,319 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8461785ef16c68760c326406dffef392 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 14:54:06,755 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113043ad5d5bab8c456d956b7b3e9cd66190 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113043ad5d5bab8c456d956b7b3e9cd66190 2023-10-30 14:54:07,161 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/356f0b4e9dfd4be28b3e7badd1321ff9 2023-10-30 14:54:07,179 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/356f0b4e9dfd4be28b3e7badd1321ff9 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/356f0b4e9dfd4be28b3e7badd1321ff9 2023-10-30 14:54:07,185 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/356f0b4e9dfd4be28b3e7badd1321ff9, entries=1000, sequenceid=5, filesize=190.5 K 2023-10-30 14:54:07,186 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 8461785ef16c68760c326406dffef392 in 867ms, sequenceid=5, compaction requested=false 2023-10-30 14:54:07,186 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:07,187 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:07,187 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:07,187 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:54:07,187 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:54:07,187 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:07,187 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 14:54:07,187 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 14:54:07,188 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:07,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:07,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:07,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:07,188 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:07,189 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,189 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:07,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:07,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:07,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:07,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 14:54:07,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3be2fab3[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:07,189 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 14:54:07,189 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,190 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,190 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 14:54:07,190 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 14:54:07,190 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:07,190 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:07,190 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:07,191 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:07,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:07,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:07,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:07,191 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 14:54:07,191 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:07,191 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 14:54:07,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:07,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:07,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:07,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:07,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:07,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:07,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 14:54:07,193 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 14:54:07,193 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:07,193 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:07,193 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,193 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:07,194 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,194 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:07,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:07,194 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:07,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,194 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:07,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:07,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:07,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:07,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:07,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,195 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:07,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:07,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:07,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:07,198 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:07,198 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,198 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,198 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:07,198 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:07,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:07,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:07,198 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:07,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:07,198 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:07,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:07,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 14:54:07,199 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,199 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:07,199 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,199 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:07,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:07,199 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:07,314 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:07,315 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 14:54:07,315 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0da6e888 to 127.0.0.1:49804 2023-10-30 14:54:07,315 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:54:07,317 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00ca2246 to 127.0.0.1:49804 2023-10-30 14:54:07,318 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:54:07,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:07,328 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 14:54:07,328 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d7a9173 to 127.0.0.1:49804 2023-10-30 14:54:07,328 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:54:07,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:07,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 14:54:07,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,338 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:07,338 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:07,338 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 14:54:07,338 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 14:54:07,341 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 14:54:07,341 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a57fa20 to 127.0.0.1:49804 2023-10-30 14:54:07,341 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:54:07,341 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 14:54:07,341 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ee17499 to 127.0.0.1:49804 2023-10-30 14:54:07,341 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:54:07,428 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,428 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,529 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:07,529 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:07,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:07,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:07,530 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:07,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,530 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:07,530 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:07,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,530 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,530 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:07,530 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 14:54:07,530 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:07,531 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 14:54:07,531 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:54:07,531 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:07,531 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:07,531 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. started... 2023-10-30 14:54:07,531 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8461785ef16c68760c326406dffef392 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 14:54:07,842 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 14:54:07,944 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128eff6265b9d944a01bd22d13156d764b5 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128eff6265b9d944a01bd22d13156d764b5 2023-10-30 14:54:08,353 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/b17351b1f6614924922192ad044510c8 2023-10-30 14:54:08,360 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/b17351b1f6614924922192ad044510c8 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/b17351b1f6614924922192ad044510c8 2023-10-30 14:54:08,364 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/b17351b1f6614924922192ad044510c8, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 14:54:08,365 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 8461785ef16c68760c326406dffef392 in 834ms, sequenceid=9, compaction requested=false 2023-10-30 14:54:08,365 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:08,365 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:08,365 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:54:08,365 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:54:08,365 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:08,365 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 14:54:08,365 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 14:54:08,366 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,366 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:08,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:08,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:08,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:08,367 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,367 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:08,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:08,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:08,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:08,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:08,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 14:54:08,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d8feceb[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:08,368 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 14:54:08,368 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,369 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,369 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 14:54:08,369 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 14:54:08,369 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:08,369 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:08,369 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:08,370 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 14:54:08,370 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:08,370 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:08,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:08,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:08,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:08,370 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 14:54:08,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:08,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:08,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:08,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:08,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:08,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:08,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 14:54:08,374 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 14:54:08,374 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:08,374 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:08,374 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,374 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:08,381 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,381 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:08,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:08,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,381 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:08,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:08,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:08,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:08,382 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:08,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:08,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:08,384 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:08,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:08,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:08,391 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:08,391 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:08,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:08,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:08,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:08,391 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:08,392 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:08,391 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,392 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:08,392 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:08,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:08,392 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,393 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:08,393 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,393 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,393 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,492 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:08,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:08,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:08,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 14:54:08,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,502 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:08,502 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:08,502 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 14:54:08,502 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 14:54:08,503 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,503 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,505 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:08,505 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:08,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:08,506 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:08,506 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,507 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,508 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 14:54:08,508 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:08,508 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 14:54:08,508 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:08,508 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 14:54:08,508 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:54:08,508 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:08,508 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:08,509 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. started... 2023-10-30 14:54:08,509 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8461785ef16c68760c326406dffef392 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:54:08,934 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ad2b7c05810e40cebb7b3623d7a55216 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201ad2b7c05810e40cebb7b3623d7a55216 2023-10-30 14:54:09,341 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/859c86b96879413e8010754ffa7b4625 2023-10-30 14:54:09,345 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/859c86b96879413e8010754ffa7b4625 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/859c86b96879413e8010754ffa7b4625 2023-10-30 14:54:09,350 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/859c86b96879413e8010754ffa7b4625, entries=1, sequenceid=13, filesize=5.0 K 2023-10-30 14:54:09,351 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8461785ef16c68760c326406dffef392 in 842ms, sequenceid=13, compaction requested=true 2023-10-30 14:54:09,351 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:09,351 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:09,351 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:54:09,351 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:54:09,351 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:09,351 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 14:54:09,351 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 14:54:09,353 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:09,353 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:09,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:09,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:09,353 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,353 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:09,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:09,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:09,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:09,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:09,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 14:54:09,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35f9ff95[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:09,355 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 14:54:09,355 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,356 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,356 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 14:54:09,356 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 14:54:09,356 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:09,356 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:09,356 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:09,357 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 14:54:09,357 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:09,357 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 14:54:09,357 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:09,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:09,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:09,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:09,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 14:54:09,360 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 14:54:09,360 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:09,360 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:09,360 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,360 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:09,361 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,361 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:09,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:09,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,361 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:09,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:09,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:09,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:09,362 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:09,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:09,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:09,363 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:09,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:09,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:09,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:09,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:09,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:09,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:09,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:09,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:09,365 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:09,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:09,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:09,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,365 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:09,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:09,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:09,365 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,365 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:09,465 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:09,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:09,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:09,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 14:54:09,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,477 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:09,477 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:09,477 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 14:54:09,477 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 14:54:09,478 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,478 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,482 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:09,482 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:09,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:09,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:09,482 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:09,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,483 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:09,483 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:09,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,484 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,485 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 14:54:09,485 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:09,485 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 14:54:09,485 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:09,485 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 14:54:09,485 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:54:09,485 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:09,486 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:09,486 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. started... 2023-10-30 14:54:09,486 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8461785ef16c68760c326406dffef392 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:54:09,905 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120517e9328158014d77b9cb90d9a06831a2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120517e9328158014d77b9cb90d9a06831a2 2023-10-30 14:54:10,312 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/d4c7a9cf1a714490a5e88bdfacae36ed 2023-10-30 14:54:10,324 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/d4c7a9cf1a714490a5e88bdfacae36ed as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/d4c7a9cf1a714490a5e88bdfacae36ed 2023-10-30 14:54:10,330 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/d4c7a9cf1a714490a5e88bdfacae36ed, entries=1, sequenceid=17, filesize=5.0 K 2023-10-30 14:54:10,331 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8461785ef16c68760c326406dffef392 in 845ms, sequenceid=17, compaction requested=true 2023-10-30 14:54:10,331 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:10,331 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:10,331 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:54:10,332 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:54:10,332 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:10,332 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 14:54:10,332 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 14:54:10,333 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:10,333 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:10,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:10,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:10,334 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,334 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:10,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:10,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:10,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:10,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 14:54:10,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@656da3b8[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:10,336 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 14:54:10,336 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,337 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,337 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 14:54:10,338 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 14:54:10,338 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:10,338 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:10,338 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:10,339 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 14:54:10,339 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:10,339 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 14:54:10,339 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:10,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:10,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:10,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:10,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:10,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:10,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:10,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:10,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:10,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:10,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 14:54:10,344 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 14:54:10,344 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:10,344 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:10,344 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,344 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:10,350 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,350 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:10,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:10,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,350 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:10,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:10,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:10,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:10,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,351 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:10,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:10,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:10,353 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:10,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:10,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:10,358 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:10,358 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:10,358 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,358 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:10,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 14:54:10,358 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:10,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:10,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:10,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:10,358 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:10,358 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:10,359 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,359 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,359 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:10,359 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:10,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:10,359 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:10,459 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:10,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:10,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:10,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 14:54:10,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,470 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:10,470 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:10,470 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 14:54:10,470 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 14:54:10,471 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,471 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,473 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:10,473 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:10,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:10,473 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:10,473 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:10,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,475 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,475 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 14:54:10,475 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:10,475 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 14:54:10,475 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:10,475 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 14:54:10,475 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:54:10,475 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:10,475 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:10,475 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. started... 2023-10-30 14:54:10,475 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8461785ef16c68760c326406dffef392 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:54:10,895 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228bcdcfe99fea44f349a9b85eadc77507d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228bcdcfe99fea44f349a9b85eadc77507d 2023-10-30 14:54:11,303 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/06b325b36d464faabc183d97f8d0bd7e 2023-10-30 14:54:11,315 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/06b325b36d464faabc183d97f8d0bd7e as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/06b325b36d464faabc183d97f8d0bd7e 2023-10-30 14:54:11,319 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/06b325b36d464faabc183d97f8d0bd7e, entries=1, sequenceid=21, filesize=5.0 K 2023-10-30 14:54:11,320 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8461785ef16c68760c326406dffef392 in 845ms, sequenceid=21, compaction requested=true 2023-10-30 14:54:11,320 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:11,320 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:11,320 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:54:11,320 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:54:11,320 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:11,320 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 14:54:11,320 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 14:54:11,338 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:11,338 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:11,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:11,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:11,339 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,339 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:11,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:11,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:11,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:11,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:11,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 14:54:11,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4976fac4[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:11,341 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 14:54:11,341 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,389 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,390 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 14:54:11,390 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 14:54:11,390 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:11,390 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:11,390 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:11,392 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 14:54:11,392 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:11,392 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:11,392 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 14:54:11,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:11,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:11,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:11,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:11,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:11,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:11,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:11,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:11,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:11,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 14:54:11,401 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 14:54:11,401 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:11,401 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:11,401 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,401 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:11,414 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,414 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,414 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:11,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:11,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:11,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:11,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:11,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:11,416 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:11,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:11,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:11,421 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:11,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:11,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:11,424 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:11,425 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,425 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,425 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:11,425 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,425 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:11,425 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,425 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 14:54:11,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:11,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:11,425 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:11,425 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:11,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:11,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:11,425 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:11,426 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:11,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:11,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:11,526 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:11,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:11,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:11,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 14:54:11,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,541 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:11,541 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:11,541 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 14:54:11,541 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 14:54:11,542 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,542 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,543 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:11,543 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:11,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:11,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:11,544 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:11,544 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:11,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:11,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,545 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,546 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 14:54:11,546 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:11,546 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 14:54:11,546 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:11,546 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 14:54:11,546 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:54:11,546 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:11,546 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:11,546 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. started... 2023-10-30 14:54:11,547 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8461785ef16c68760c326406dffef392 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:54:11,964 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319e259ae4d8c548df90f3f5fea0eecc26 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512319e259ae4d8c548df90f3f5fea0eecc26 2023-10-30 14:54:12,370 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/1c569a9b1d764776b298c0f05a038f77 2023-10-30 14:54:12,381 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/1c569a9b1d764776b298c0f05a038f77 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/1c569a9b1d764776b298c0f05a038f77 2023-10-30 14:54:12,387 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/1c569a9b1d764776b298c0f05a038f77, entries=1, sequenceid=25, filesize=5.0 K 2023-10-30 14:54:12,388 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8461785ef16c68760c326406dffef392 in 841ms, sequenceid=25, compaction requested=true 2023-10-30 14:54:12,388 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:12,388 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:12,388 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:54:12,388 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:54:12,388 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:12,389 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 14:54:12,389 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 14:54:12,390 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,390 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:12,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:12,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:12,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:12,391 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,391 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:12,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:12,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:12,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:12,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:12,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 14:54:12,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bacafb5[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:12,394 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 14:54:12,394 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,395 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,395 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 14:54:12,395 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 14:54:12,395 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:12,396 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:12,396 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:12,398 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:12,398 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 14:54:12,398 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:12,398 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 14:54:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:12,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:12,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:12,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:12,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:12,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 14:54:12,402 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 14:54:12,402 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:12,402 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:12,402 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,402 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:12,404 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,404 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:12,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,405 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:12,406 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:12,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:12,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:12,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:12,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,408 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:12,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:12,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:12,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:12,416 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:12,416 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,416 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,416 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:12,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:12,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:12,416 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:12,417 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:12,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:12,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:12,416 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,417 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:12,417 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:12,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 14:54:12,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:12,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:12,416 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:12,417 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,418 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,517 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:12,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:12,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:12,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 14:54:12,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,531 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:12,532 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:12,532 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 14:54:12,532 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 14:54:12,533 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,533 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,534 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:12,534 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:12,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:12,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:12,535 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:12,535 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:12,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,536 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:12,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,537 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,537 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 14:54:12,537 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:12,537 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 14:54:12,537 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:12,537 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 14:54:12,537 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:54:12,537 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:12,538 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:12,538 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. started... 2023-10-30 14:54:12,538 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8461785ef16c68760c326406dffef392 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:54:12,963 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601013578c98edc2d409bb950d90ff3fd08e7 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601013578c98edc2d409bb950d90ff3fd08e7 2023-10-30 14:54:13,371 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/43150e624cd54041af9d255a0cb1cc2d 2023-10-30 14:54:13,381 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/43150e624cd54041af9d255a0cb1cc2d as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/43150e624cd54041af9d255a0cb1cc2d 2023-10-30 14:54:13,387 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/43150e624cd54041af9d255a0cb1cc2d, entries=1, sequenceid=29, filesize=5.0 K 2023-10-30 14:54:13,388 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8461785ef16c68760c326406dffef392 in 850ms, sequenceid=29, compaction requested=true 2023-10-30 14:54:13,389 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:13,389 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:13,389 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:54:13,389 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:54:13,389 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:13,389 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 14:54:13,389 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 14:54:13,391 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:13,391 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:13,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:13,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:13,391 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,391 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:13,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:13,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:13,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:13,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:13,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 14:54:13,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@153f202[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:13,394 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 14:54:13,394 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,394 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,395 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 14:54:13,395 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 14:54:13,395 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:13,395 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:13,395 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:13,396 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:13,396 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 14:54:13,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:13,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:13,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:13,396 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:13,396 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 14:54:13,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:13,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:13,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:13,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:13,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:13,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:13,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 14:54:13,399 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 14:54:13,399 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:13,399 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:13,399 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,399 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:13,408 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,408 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:13,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:13,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,408 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:13,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:13,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:13,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:13,409 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:13,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:13,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,412 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:13,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:13,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:13,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:13,416 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:13,416 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:13,416 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:13,416 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,416 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:13,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 14:54:13,416 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,417 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:13,417 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:13,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:13,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:13,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:13,417 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,417 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,417 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:13,417 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:13,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:13,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:13,518 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:13,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:13,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:13,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 14:54:13,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,530 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:13,530 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:13,530 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 14:54:13,530 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 14:54:13,530 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,531 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,531 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:13,531 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:13,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:13,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:13,532 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:13,532 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,532 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,533 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 14:54:13,533 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:13,533 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 14:54:13,533 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:13,533 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 14:54:13,533 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:54:13,533 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:13,533 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:13,533 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. started... 2023-10-30 14:54:13,533 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8461785ef16c68760c326406dffef392 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:54:13,955 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103241717dbda0d48ce979125ace6bd460d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103241717dbda0d48ce979125ace6bd460d 2023-10-30 14:54:14,362 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/d5183224fc0a48519ed56a0ccad4b8e6 2023-10-30 14:54:14,375 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/d5183224fc0a48519ed56a0ccad4b8e6 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/d5183224fc0a48519ed56a0ccad4b8e6 2023-10-30 14:54:14,382 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/d5183224fc0a48519ed56a0ccad4b8e6, entries=1, sequenceid=33, filesize=5.0 K 2023-10-30 14:54:14,383 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8461785ef16c68760c326406dffef392 in 850ms, sequenceid=33, compaction requested=true 2023-10-30 14:54:14,383 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:14,383 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:14,383 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:54:14,383 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:54:14,383 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,383 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 14:54:14,383 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 14:54:14,384 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,384 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:14,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:14,385 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,385 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:14,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:14,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:14,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:14,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 14:54:14,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@92bf1f3[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:14,386 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 14:54:14,386 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,387 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,387 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 14:54:14,387 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 14:54:14,387 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:14,387 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,387 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:14,388 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 14:54:14,388 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,388 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:14,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:14,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:14,388 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 14:54:14,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:14,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:14,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:14,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:14,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 14:54:14,390 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 14:54:14,390 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:14,390 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:14,390 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,390 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:14,391 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,391 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,391 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:14,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:14,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:14,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:14,391 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:14,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:14,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:14,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,392 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:14,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,394 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,394 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,394 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:14,394 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:14,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:14,394 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,394 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:14,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 14:54:14,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:14,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:14,394 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,394 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:14,394 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:14,395 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,395 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:14,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:14,395 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:14,495 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:14,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:14,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:14,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 14:54:14,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,502 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:14,502 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:14,502 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 14:54:14,502 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 14:54:14,503 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,503 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,504 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,504 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:14,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:14,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:14,504 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,504 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:14,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,505 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:14,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,505 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,506 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 14:54:14,506 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,506 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 14:54:14,506 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:14,506 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 14:54:14,506 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:54:14,506 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:14,506 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:14,506 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. started... 2023-10-30 14:54:14,506 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8461785ef16c68760c326406dffef392 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:54:14,519 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090782de9a17f9504c32b59ae894e41e10f3 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015090782de9a17f9504c32b59ae894e41e10f3 2023-10-30 14:54:14,932 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/2efff90688664094a600664f88d176ce 2023-10-30 14:54:14,941 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/2efff90688664094a600664f88d176ce as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/2efff90688664094a600664f88d176ce 2023-10-30 14:54:14,945 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/2efff90688664094a600664f88d176ce, entries=1, sequenceid=37, filesize=5.0 K 2023-10-30 14:54:14,946 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8461785ef16c68760c326406dffef392 in 440ms, sequenceid=37, compaction requested=true 2023-10-30 14:54:14,946 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:14,946 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:14,946 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:54:14,946 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:54:14,946 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,947 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 14:54:14,947 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 14:54:14,948 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,948 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:14,948 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,948 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:14,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 14:54:14,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77759ac8[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:14,949 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 14:54:14,949 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,950 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,950 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 14:54:14,950 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,950 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:14,950 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 14:54:14,950 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:14,951 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,951 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 14:54:14,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:14,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:14,951 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:14,951 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 14:54:14,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:14,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:14,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:14,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:14,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 14:54:14,953 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 14:54:14,953 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:14,953 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:14,953 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,953 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:14,953 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,954 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:14,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:14,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,954 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:14,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:14,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:14,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:14,954 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:14,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,955 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:14,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,956 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,956 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:14,956 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,956 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,956 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:14,956 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:14,956 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:14,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:14,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:14,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:14,956 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:14,956 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,956 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:14,957 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:14,957 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:14,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:14,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:15,057 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:15,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:15,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:15,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 14:54:15,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,070 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:15,070 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:15,070 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 14:54:15,071 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 14:54:15,071 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,071 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,072 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:15,072 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:15,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:15,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:15,072 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:15,072 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:15,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:15,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,074 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,074 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 14:54:15,074 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,074 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 14:54:15,074 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:15,074 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 14:54:15,075 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:54:15,075 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:15,075 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:15,075 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. started... 2023-10-30 14:54:15,075 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8461785ef16c68760c326406dffef392 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:54:15,499 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112001068f037a004521acd0066d66b16b5c to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112001068f037a004521acd0066d66b16b5c 2023-10-30 14:54:15,906 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/8ee062b0a2944c81b0a325afbcb99e21 2023-10-30 14:54:15,917 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/8ee062b0a2944c81b0a325afbcb99e21 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/8ee062b0a2944c81b0a325afbcb99e21 2023-10-30 14:54:15,922 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/8ee062b0a2944c81b0a325afbcb99e21, entries=1, sequenceid=41, filesize=5.0 K 2023-10-30 14:54:15,923 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8461785ef16c68760c326406dffef392 in 848ms, sequenceid=41, compaction requested=true 2023-10-30 14:54:15,924 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:15,924 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:15,924 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:54:15,924 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:54:15,924 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:15,924 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 14:54:15,924 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 14:54:15,925 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:15,925 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:15,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:15,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:15,926 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,926 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:15,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:15,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:15,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:15,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:15,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 14:54:15,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69ba4294[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:15,929 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 14:54:15,929 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,930 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,930 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 14:54:15,930 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 14:54:15,930 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:15,930 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:15,930 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:15,931 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 14:54:15,931 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:15,931 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:15,931 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 14:54:15,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:15,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:15,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:15,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:15,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:15,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:15,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:15,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:15,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:15,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 14:54:15,935 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 14:54:15,935 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:15,935 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:15,935 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,936 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:15,939 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,939 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,939 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:15,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:15,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:15,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:15,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:15,940 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:15,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:15,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:15,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,942 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:15,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:15,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:15,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:15,949 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:15,949 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:15,950 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:15,949 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,950 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:15,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 14:54:15,950 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:15,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:15,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:15,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:15,950 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:15,950 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,950 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,950 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:15,950 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:15,951 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:15,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:16,051 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:16,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:16,057 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43911] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:16,061 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 14:54:16,062 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 14:54:16,063 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:54:16,063 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698678256063 2023-10-30 14:54:16,067 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 14:54:16,067 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-30 14:54:16,067 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 14:54:16,069 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] zookeeper.ReadOnlyZKClient(139): Connect 0x5f1ab284 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:54:16,073 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@724cd017, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:54:16,073 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:16,931 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036cc3db93ec1e4a82876974e9bdfed790 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601036cc3db93ec1e4a82876974e9bdfed790 2023-10-30 14:54:16,932 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 14:54:16,947 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:54:16,948 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:54:16,954 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 14:54:16,955 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 14:54:16,964 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/150daf6cf58b48419cc94d77beb4b600 first=Optional[r3] last=Optional[r6] 2023-10-30 14:54:16,964 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/150daf6cf58b48419cc94d77beb4b600}] 2023-10-30 14:54:16,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/150daf6cf58b48419cc94d77beb4b600 for inclusion in 8461785ef16c68760c326406dffef392/family1 2023-10-30 14:54:16,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-30 14:54:16,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:54:16,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:16,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/150daf6cf58b48419cc94d77beb4b600 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__5ifjs6b1f94n0el3jfghlsv8gll6duim1r7u4c55rhl1v4d83est40qlv4njqd2p/family1/150daf6cf58b48419cc94d77beb4b600 2023-10-30 14:54:16,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__5ifjs6b1f94n0el3jfghlsv8gll6duim1r7u4c55rhl1v4d83est40qlv4njqd2p/family1/150daf6cf58b48419cc94d77beb4b600 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/af35b1dd964e4e6c9f981f705a704ba4_SeqId_44_ 2023-10-30 14:54:16,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__5ifjs6b1f94n0el3jfghlsv8gll6duim1r7u4c55rhl1v4d83est40qlv4njqd2p/family1/150daf6cf58b48419cc94d77beb4b600 into 8461785ef16c68760c326406dffef392/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/af35b1dd964e4e6c9f981f705a704ba4_SeqId_44_ - updating store file list. 2023-10-30 14:54:16,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/af35b1dd964e4e6c9f981f705a704ba4_SeqId_44_ into 8461785ef16c68760c326406dffef392/family1 2023-10-30 14:54:16,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__5ifjs6b1f94n0el3jfghlsv8gll6duim1r7u4c55rhl1v4d83est40qlv4njqd2p/family1/150daf6cf58b48419cc94d77beb4b600 into 8461785ef16c68760c326406dffef392/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/af35b1dd964e4e6c9f981f705a704ba4_SeqId_44_) 2023-10-30 14:54:16,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__5ifjs6b1f94n0el3jfghlsv8gll6duim1r7u4c55rhl1v4d83est40qlv4njqd2p/family1/150daf6cf58b48419cc94d77beb4b600 2023-10-30 14:54:16,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 14:54:16,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 14:54:16,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(1912): 8461785ef16c68760c326406dffef392/family1 is initiating minor compaction 2023-10-30 14:54:16,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@25226a07; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:54:16,981 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8461785ef16c68760c326406dffef392/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:16,981 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/b17351b1f6614924922192ad044510c8, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/859c86b96879413e8010754ffa7b4625, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/d4c7a9cf1a714490a5e88bdfacae36ed, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/06b325b36d464faabc183d97f8d0bd7e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/1c569a9b1d764776b298c0f05a038f77, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/43150e624cd54041af9d255a0cb1cc2d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/d5183224fc0a48519ed56a0ccad4b8e6, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/2efff90688664094a600664f88d176ce, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/8ee062b0a2944c81b0a325afbcb99e21, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/af35b1dd964e4e6c9f981f705a704ba4_SeqId_44_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp, totalSize=50.3 K 2023-10-30 14:54:16,981 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting b17351b1f6614924922192ad044510c8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 14:54:16,981 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 859c86b96879413e8010754ffa7b4625, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 14:54:16,982 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting d4c7a9cf1a714490a5e88bdfacae36ed, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 14:54:16,982 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 06b325b36d464faabc183d97f8d0bd7e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 14:54:16,982 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 1c569a9b1d764776b298c0f05a038f77, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 14:54:16,982 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 43150e624cd54041af9d255a0cb1cc2d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 14:54:16,982 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting d5183224fc0a48519ed56a0ccad4b8e6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 14:54:16,982 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 2efff90688664094a600664f88d176ce, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 14:54:16,982 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 8ee062b0a2944c81b0a325afbcb99e21, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 14:54:16,982 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting af35b1dd964e4e6c9f981f705a704ba4_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 14:54:16,983 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 14:54:16,984 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:16,985 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228bcdcfe99fea44f349a9b85eadc77507d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228bcdcfe99fea44f349a9b85eadc77507d 2023-10-30 14:54:16,986 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512319e259ae4d8c548df90f3f5fea0eecc26 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512319e259ae4d8c548df90f3f5fea0eecc26 2023-10-30 14:54:16,987 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601013578c98edc2d409bb950d90ff3fd08e7 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601013578c98edc2d409bb950d90ff3fd08e7 2023-10-30 14:54:16,988 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103241717dbda0d48ce979125ace6bd460d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103241717dbda0d48ce979125ace6bd460d 2023-10-30 14:54:16,988 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-10-30 14:54:16,988 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-30 14:54:16,988 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:16,988 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:16,988 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:16,988 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:16,988 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:16,988 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:16,988 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:16,988 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:17,012 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8461785ef16c68760c326406dffef392#family1#compaction#73 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:54:17,032 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/575c2c8bf880430ab0f30dc6959eaabe as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/575c2c8bf880430ab0f30dc6959eaabe 2023-10-30 14:54:17,037 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 8461785ef16c68760c326406dffef392/family1 of 8461785ef16c68760c326406dffef392 into 575c2c8bf880430ab0f30dc6959eaabe(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:54:17,037 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:17,038 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698677656981; duration=0sec 2023-10-30 14:54:17,038 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:54:17,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/b17351b1f6614924922192ad044510c8, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/859c86b96879413e8010754ffa7b4625, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/d4c7a9cf1a714490a5e88bdfacae36ed, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/06b325b36d464faabc183d97f8d0bd7e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/1c569a9b1d764776b298c0f05a038f77, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/43150e624cd54041af9d255a0cb1cc2d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/d5183224fc0a48519ed56a0ccad4b8e6, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/2efff90688664094a600664f88d176ce, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/8ee062b0a2944c81b0a325afbcb99e21, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/af35b1dd964e4e6c9f981f705a704ba4_SeqId_44_] to archive 2023-10-30 14:54:17,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:17,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/b17351b1f6614924922192ad044510c8 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/b17351b1f6614924922192ad044510c8 2023-10-30 14:54:17,133 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/859c86b96879413e8010754ffa7b4625 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/859c86b96879413e8010754ffa7b4625 2023-10-30 14:54:17,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/d4c7a9cf1a714490a5e88bdfacae36ed to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/d4c7a9cf1a714490a5e88bdfacae36ed 2023-10-30 14:54:17,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/06b325b36d464faabc183d97f8d0bd7e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/06b325b36d464faabc183d97f8d0bd7e 2023-10-30 14:54:17,137 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/1c569a9b1d764776b298c0f05a038f77 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/1c569a9b1d764776b298c0f05a038f77 2023-10-30 14:54:17,138 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/43150e624cd54041af9d255a0cb1cc2d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/43150e624cd54041af9d255a0cb1cc2d 2023-10-30 14:54:17,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/d5183224fc0a48519ed56a0ccad4b8e6 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/d5183224fc0a48519ed56a0ccad4b8e6 2023-10-30 14:54:17,141 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/2efff90688664094a600664f88d176ce to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/2efff90688664094a600664f88d176ce 2023-10-30 14:54:17,142 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/8ee062b0a2944c81b0a325afbcb99e21 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/8ee062b0a2944c81b0a325afbcb99e21 2023-10-30 14:54:17,143 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/af35b1dd964e4e6c9f981f705a704ba4_SeqId_44_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/af35b1dd964e4e6c9f981f705a704ba4_SeqId_44_ 2023-10-30 14:54:17,442 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120516b6303cd856412ba6e0f46732c49294 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120516b6303cd856412ba6e0f46732c49294 2023-10-30 14:54:17,444 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 14:54:17,471 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/737b5870e98841da82990a187137c121 first=Optional[r00] last=Optional[r2] 2023-10-30 14:54:17,472 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/737b5870e98841da82990a187137c121}] 2023-10-30 14:54:17,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/737b5870e98841da82990a187137c121 for inclusion in 8461785ef16c68760c326406dffef392/family1 2023-10-30 14:54:17,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-30 14:54:17,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:54:17,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:17,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/737b5870e98841da82990a187137c121 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__iub6husc7a76gq31oe5n9nbtroii3p25hlob90v23egljgerp9pj2s5on77hifql/family1/737b5870e98841da82990a187137c121 2023-10-30 14:54:17,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__iub6husc7a76gq31oe5n9nbtroii3p25hlob90v23egljgerp9pj2s5on77hifql/family1/737b5870e98841da82990a187137c121 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/520609225fd54f58926c1d8a15e5c92f_SeqId_47_ 2023-10-30 14:54:17,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__iub6husc7a76gq31oe5n9nbtroii3p25hlob90v23egljgerp9pj2s5on77hifql/family1/737b5870e98841da82990a187137c121 into 8461785ef16c68760c326406dffef392/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/520609225fd54f58926c1d8a15e5c92f_SeqId_47_ - updating store file list. 2023-10-30 14:54:17,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/520609225fd54f58926c1d8a15e5c92f_SeqId_47_ into 8461785ef16c68760c326406dffef392/family1 2023-10-30 14:54:17,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__iub6husc7a76gq31oe5n9nbtroii3p25hlob90v23egljgerp9pj2s5on77hifql/family1/737b5870e98841da82990a187137c121 into 8461785ef16c68760c326406dffef392/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/520609225fd54f58926c1d8a15e5c92f_SeqId_47_) 2023-10-30 14:54:17,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__iub6husc7a76gq31oe5n9nbtroii3p25hlob90v23egljgerp9pj2s5on77hifql/family1/737b5870e98841da82990a187137c121 2023-10-30 14:54:17,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 14:54:17,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 14:54:17,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(1912): 8461785ef16c68760c326406dffef392/family1 is initiating minor compaction (all files) 2023-10-30 14:54:17,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5e9aa037; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:54:17,489 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8461785ef16c68760c326406dffef392/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:17,490 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/356f0b4e9dfd4be28b3e7badd1321ff9, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/575c2c8bf880430ab0f30dc6959eaabe, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/520609225fd54f58926c1d8a15e5c92f_SeqId_47_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp, totalSize=388.1 K 2023-10-30 14:54:17,490 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 356f0b4e9dfd4be28b3e7badd1321ff9, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878852219 2023-10-30 14:54:17,490 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 575c2c8bf880430ab0f30dc6959eaabe, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621252219 2023-10-30 14:54:17,491 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 520609225fd54f58926c1d8a15e5c92f_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878852219 2023-10-30 14:54:17,491 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 14:54:17,493 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:17,494 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113043ad5d5bab8c456d956b7b3e9cd66190 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113043ad5d5bab8c456d956b7b3e9cd66190 2023-10-30 14:54:17,495 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201ad2b7c05810e40cebb7b3623d7a55216 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201ad2b7c05810e40cebb7b3623d7a55216 2023-10-30 14:54:17,496 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120517e9328158014d77b9cb90d9a06831a2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120517e9328158014d77b9cb90d9a06831a2 2023-10-30 14:54:17,496 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-10-30 14:54:17,496 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-30 14:54:17,497 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:17,497 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 14:54:17,497 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:54:17,498 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 14:54:17,499 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.4390 sec 2023-10-30 14:54:17,505 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8461785ef16c68760c326406dffef392#family1#compaction#74 average throughput is 29.94 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:54:17,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-30 14:54:17,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:17,988 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-30 14:54:17,991 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-10-30 14:54:17,991 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-30 14:54:17,996 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-10-30 14:54:18,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8461785ef16c68760c326406dffef392, REOPEN/MOVE}] 2023-10-30 14:54:18,003 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8461785ef16c68760c326406dffef392, REOPEN/MOVE 2023-10-30 14:54:18,004 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8461785ef16c68760c326406dffef392, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:18,004 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698677658004"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677658004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677658004"}]},"ts":"1698677658004"} 2023-10-30 14:54:18,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 8461785ef16c68760c326406dffef392, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:18,159 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:18,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 8461785ef16c68760c326406dffef392 2023-10-30 14:54:18,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 8461785ef16c68760c326406dffef392, disabling compactions & flushes 2023-10-30 14:54:18,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:18,748 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/.tmp/family1/0f3efd58368f467f9854e2bec7d78f13 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/0f3efd58368f467f9854e2bec7d78f13 2023-10-30 14:54:18,754 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8461785ef16c68760c326406dffef392/family1 of 8461785ef16c68760c326406dffef392 into 0f3efd58368f467f9854e2bec7d78f13(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:54:18,754 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:18,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:18,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:18,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. after waiting 0 ms 2023-10-30 14:54:18,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:18,755 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1698677657489; duration=1sec 2023-10-30 14:54:18,755 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:54:18,760 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/356f0b4e9dfd4be28b3e7badd1321ff9, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/575c2c8bf880430ab0f30dc6959eaabe, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/520609225fd54f58926c1d8a15e5c92f_SeqId_47_] to archive 2023-10-30 14:54:18,761 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:18,764 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/356f0b4e9dfd4be28b3e7badd1321ff9 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/356f0b4e9dfd4be28b3e7badd1321ff9 2023-10-30 14:54:18,766 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/575c2c8bf880430ab0f30dc6959eaabe to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/575c2c8bf880430ab0f30dc6959eaabe 2023-10-30 14:54:18,768 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/520609225fd54f58926c1d8a15e5c92f_SeqId_47_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/520609225fd54f58926c1d8a15e5c92f_SeqId_47_ 2023-10-30 14:54:18,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-30 14:54:18,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:18,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:18,775 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 8461785ef16c68760c326406dffef392 to self. 2023-10-30 14:54:18,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 8461785ef16c68760c326406dffef392 2023-10-30 14:54:18,777 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8461785ef16c68760c326406dffef392, regionState=CLOSED 2023-10-30 14:54:18,777 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698677658777"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677658777"}]},"ts":"1698677658777"} 2023-10-30 14:54:18,780 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-10-30 14:54:18,780 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 8461785ef16c68760c326406dffef392, server=jenkins-hbase20.apache.org,36359,1698677568317 in 772 msec 2023-10-30 14:54:18,780 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8461785ef16c68760c326406dffef392, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=true 2023-10-30 14:54:18,931 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8461785ef16c68760c326406dffef392, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:18,931 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698677658930"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677658930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677658930"}]},"ts":"1698677658930"} 2023-10-30 14:54:18,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 8461785ef16c68760c326406dffef392, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:19,086 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:19,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:19,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8461785ef16c68760c326406dffef392, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.', STARTKEY => '', ENDKEY => ''} 2023-10-30 14:54:19,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 8461785ef16c68760c326406dffef392 2023-10-30 14:54:19,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:19,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 8461785ef16c68760c326406dffef392 2023-10-30 14:54:19,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 8461785ef16c68760c326406dffef392 2023-10-30 14:54:19,098 INFO [StoreOpener-8461785ef16c68760c326406dffef392-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8461785ef16c68760c326406dffef392 2023-10-30 14:54:19,100 DEBUG [StoreOpener-8461785ef16c68760c326406dffef392-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1 2023-10-30 14:54:19,100 DEBUG [StoreOpener-8461785ef16c68760c326406dffef392-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1 2023-10-30 14:54:19,101 INFO [StoreOpener-8461785ef16c68760c326406dffef392-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8461785ef16c68760c326406dffef392 columnFamilyName family1 2023-10-30 14:54:19,109 DEBUG [StoreOpener-8461785ef16c68760c326406dffef392-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/0f3efd58368f467f9854e2bec7d78f13 2023-10-30 14:54:19,110 INFO [StoreOpener-8461785ef16c68760c326406dffef392-1] regionserver.HStore(310): Store=8461785ef16c68760c326406dffef392/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:19,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392 2023-10-30 14:54:19,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392 2023-10-30 14:54:19,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 8461785ef16c68760c326406dffef392 2023-10-30 14:54:19,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 8461785ef16c68760c326406dffef392; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75478631, jitterRate=0.12471924722194672}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 14:54:19,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:19,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392., pid=63, masterSystemTime=1698677659086 2023-10-30 14:54:19,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:19,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:19,117 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8461785ef16c68760c326406dffef392, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:19,117 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698677659117"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677659117"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677659117"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677659117"}]},"ts":"1698677659117"} 2023-10-30 14:54:19,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-10-30 14:54:19,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 8461785ef16c68760c326406dffef392, server=jenkins-hbase20.apache.org,36359,1698677568317 in 185 msec 2023-10-30 14:54:19,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-10-30 14:54:19,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8461785ef16c68760c326406dffef392, REOPEN/MOVE in 1.1180 sec 2023-10-30 14:54:19,122 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-10-30 14:54:19,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1250 sec 2023-10-30 14:54:19,124 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5460 sec 2023-10-30 14:54:19,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-10-30 14:54:19,127 INFO [Listener at localhost/34621] compactions.TestMobCompactor(278): alter status finished 2023-10-30 14:54:19,128 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43911] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:19,129 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 14:54:19,130 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 14:54:19,130 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698678259130 2023-10-30 14:54:19,130 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:54:19,131 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 14:54:19,132 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-30 14:54:19,132 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 14:54:19,133 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] zookeeper.ReadOnlyZKClient(139): Connect 0x0c7ce870 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:54:19,137 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65387116, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:54:19,137 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:19,138 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:19,138 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:19,138 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:19,138 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:19,976 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128bb7189cd8bbd467798758f98958fa8be to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128bb7189cd8bbd467798758f98958fa8be 2023-10-30 14:54:19,977 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 14:54:19,990 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:54:19,991 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:54:19,998 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 14:54:20,000 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 14:54:20,009 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c7cb8ff72a754378bb52fe7c2269dcc5 first=Optional[r05] last=Optional[r8] 2023-10-30 14:54:20,010 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=51 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c7cb8ff72a754378bb52fe7c2269dcc5}] 2023-10-30 14:54:20,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c7cb8ff72a754378bb52fe7c2269dcc5 for inclusion in 8461785ef16c68760c326406dffef392/family1 2023-10-30 14:54:20,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-30 14:54:20,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:54:20,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:20,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c7cb8ff72a754378bb52fe7c2269dcc5 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cm6rohb0fm4v2jld8dumjcm2g0u9q4e9uahi230kfngoehkg0r48qjk2sn5pq2ug/family1/c7cb8ff72a754378bb52fe7c2269dcc5 2023-10-30 14:54:20,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cm6rohb0fm4v2jld8dumjcm2g0u9q4e9uahi230kfngoehkg0r48qjk2sn5pq2ug/family1/c7cb8ff72a754378bb52fe7c2269dcc5 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/577654ed5121464ab971a6e20eb3c036_SeqId_53_ 2023-10-30 14:54:20,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cm6rohb0fm4v2jld8dumjcm2g0u9q4e9uahi230kfngoehkg0r48qjk2sn5pq2ug/family1/c7cb8ff72a754378bb52fe7c2269dcc5 into 8461785ef16c68760c326406dffef392/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/577654ed5121464ab971a6e20eb3c036_SeqId_53_ - updating store file list. 2023-10-30 14:54:20,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/577654ed5121464ab971a6e20eb3c036_SeqId_53_ into 8461785ef16c68760c326406dffef392/family1 2023-10-30 14:54:20,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cm6rohb0fm4v2jld8dumjcm2g0u9q4e9uahi230kfngoehkg0r48qjk2sn5pq2ug/family1/c7cb8ff72a754378bb52fe7c2269dcc5 into 8461785ef16c68760c326406dffef392/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/577654ed5121464ab971a6e20eb3c036_SeqId_53_) 2023-10-30 14:54:20,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cm6rohb0fm4v2jld8dumjcm2g0u9q4e9uahi230kfngoehkg0r48qjk2sn5pq2ug/family1/c7cb8ff72a754378bb52fe7c2269dcc5 2023-10-30 14:54:20,029 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 14:54:20,030 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:20,032 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112001068f037a004521acd0066d66b16b5c to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112001068f037a004521acd0066d66b16b5c 2023-10-30 14:54:20,034 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128eff6265b9d944a01bd22d13156d764b5 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128eff6265b9d944a01bd22d13156d764b5 2023-10-30 14:54:20,034 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-10-30 14:54:20,034 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-30 14:54:20,034 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:20,034 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:20,034 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:20,034 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 14:54:20,035 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:54:20,036 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 14:54:20,037 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 908 msec 2023-10-30 14:54:20,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-10-30 14:54:20,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:20,502 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-10-30 14:54:20,504 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-30 14:54:20,504 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-10-30 14:54:20,507 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-10-30 14:54:20,511 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8461785ef16c68760c326406dffef392, REOPEN/MOVE}] 2023-10-30 14:54:20,512 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8461785ef16c68760c326406dffef392, REOPEN/MOVE 2023-10-30 14:54:20,514 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8461785ef16c68760c326406dffef392, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:20,514 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698677660514"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677660514"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677660514"}]},"ts":"1698677660514"} 2023-10-30 14:54:20,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 8461785ef16c68760c326406dffef392, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:20,669 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:20,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 8461785ef16c68760c326406dffef392 2023-10-30 14:54:20,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 8461785ef16c68760c326406dffef392, disabling compactions & flushes 2023-10-30 14:54:20,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:20,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:20,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. after waiting 0 ms 2023-10-30 14:54:20,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:20,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-30 14:54:20,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:20,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:20,682 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 8461785ef16c68760c326406dffef392 to self. 2023-10-30 14:54:20,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 8461785ef16c68760c326406dffef392 2023-10-30 14:54:20,684 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8461785ef16c68760c326406dffef392, regionState=CLOSED 2023-10-30 14:54:20,684 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698677660684"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677660684"}]},"ts":"1698677660684"} 2023-10-30 14:54:20,686 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-10-30 14:54:20,686 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 8461785ef16c68760c326406dffef392, server=jenkins-hbase20.apache.org,36359,1698677568317 in 169 msec 2023-10-30 14:54:20,687 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8461785ef16c68760c326406dffef392, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=true 2023-10-30 14:54:20,837 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8461785ef16c68760c326406dffef392, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:20,838 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698677660837"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677660837"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677660837"}]},"ts":"1698677660837"} 2023-10-30 14:54:20,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 8461785ef16c68760c326406dffef392, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:20,995 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:20,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:20,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8461785ef16c68760c326406dffef392, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.', STARTKEY => '', ENDKEY => ''} 2023-10-30 14:54:21,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 8461785ef16c68760c326406dffef392 2023-10-30 14:54:21,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:21,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 8461785ef16c68760c326406dffef392 2023-10-30 14:54:21,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 8461785ef16c68760c326406dffef392 2023-10-30 14:54:21,003 INFO [StoreOpener-8461785ef16c68760c326406dffef392-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8461785ef16c68760c326406dffef392 2023-10-30 14:54:21,005 DEBUG [StoreOpener-8461785ef16c68760c326406dffef392-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1 2023-10-30 14:54:21,005 DEBUG [StoreOpener-8461785ef16c68760c326406dffef392-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1 2023-10-30 14:54:21,005 INFO [StoreOpener-8461785ef16c68760c326406dffef392-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8461785ef16c68760c326406dffef392 columnFamilyName family1 2023-10-30 14:54:21,015 DEBUG [StoreOpener-8461785ef16c68760c326406dffef392-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/0f3efd58368f467f9854e2bec7d78f13 2023-10-30 14:54:21,020 DEBUG [StoreOpener-8461785ef16c68760c326406dffef392-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/family1/577654ed5121464ab971a6e20eb3c036_SeqId_53_ 2023-10-30 14:54:21,020 INFO [StoreOpener-8461785ef16c68760c326406dffef392-1] regionserver.HStore(310): Store=8461785ef16c68760c326406dffef392/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:21,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392 2023-10-30 14:54:21,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392 2023-10-30 14:54:21,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 8461785ef16c68760c326406dffef392 2023-10-30 14:54:21,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 8461785ef16c68760c326406dffef392; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72499409, jitterRate=0.08032537996768951}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 14:54:21,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:54:21,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392., pid=69, masterSystemTime=1698677660995 2023-10-30 14:54:21,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:21,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:54:21,031 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8461785ef16c68760c326406dffef392, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:21,031 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698677661031"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677661031"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677661031"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677661031"}]},"ts":"1698677661031"} 2023-10-30 14:54:21,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-10-30 14:54:21,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 8461785ef16c68760c326406dffef392, server=jenkins-hbase20.apache.org,36359,1698677568317 in 192 msec 2023-10-30 14:54:21,037 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-30 14:54:21,037 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8461785ef16c68760c326406dffef392, REOPEN/MOVE in 524 msec 2023-10-30 14:54:21,040 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-10-30 14:54:21,040 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 531 msec 2023-10-30 14:54:21,042 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 949 msec 2023-10-30 14:54:21,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-10-30 14:54:21,045 INFO [Listener at localhost/34621] compactions.TestMobCompactor(278): alter status finished 2023-10-30 14:54:21,046 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43911] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 14:54:21,047 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 14:54:21,048 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 14:54:21,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:54:21,049 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698678261049 2023-10-30 14:54:21,050 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 14:54:21,050 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-30 14:54:21,050 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 14:54:21,052 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] zookeeper.ReadOnlyZKClient(139): Connect 0x53d55b96 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:54:21,056 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a15c75b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:54:21,056 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:21,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:21,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:21,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:21,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:21,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:21,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:21,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 14:54:21,057 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 14:54:21,057 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:54:21,058 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 14:54:21,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 11 msec 2023-10-30 14:54:21,102 INFO [Listener at localhost/34621] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=243 (was 250), OpenFileDescriptor=624 (was 631), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=340 (was 369), ProcessCount=168 (was 169), AvailableMemoryMB=1656 (was 1706) 2023-10-30 14:54:21,112 INFO [Listener at localhost/34621] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=243, OpenFileDescriptor=624, MaxFileDescriptor=60000, SystemLoadAverage=340, ProcessCount=168, AvailableMemoryMB=1656 2023-10-30 14:54:21,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-30 14:54:21,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-10-30 14:54:21,117 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 14:54:21,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-10-30 14:54:21,118 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 14:54:21,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 14:54:21,119 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8 2023-10-30 14:54:21,119 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8 empty. 2023-10-30 14:54:21,120 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8 2023-10-30 14:54:21,120 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-10-30 14:54:21,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 14:54:21,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 14:54:21,528 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-10-30 14:54:21,530 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7eb2f68b4253f0defd394f12e58a84a8, NAME => 'testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:54:21,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 14:54:21,940 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:21,940 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 7eb2f68b4253f0defd394f12e58a84a8, disabling compactions & flushes 2023-10-30 14:54:21,940 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8. 2023-10-30 14:54:21,940 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8. 2023-10-30 14:54:21,941 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8. after waiting 0 ms 2023-10-30 14:54:21,941 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8. 2023-10-30 14:54:21,941 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8. 2023-10-30 14:54:21,941 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 7eb2f68b4253f0defd394f12e58a84a8: 2023-10-30 14:54:21,946 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 14:54:21,949 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698677661949"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677661949"}]},"ts":"1698677661949"} 2023-10-30 14:54:21,951 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 14:54:21,953 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 14:54:21,953 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677661953"}]},"ts":"1698677661953"} 2023-10-30 14:54:21,955 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-10-30 14:54:21,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=7eb2f68b4253f0defd394f12e58a84a8, ASSIGN}] 2023-10-30 14:54:21,961 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=7eb2f68b4253f0defd394f12e58a84a8, ASSIGN 2023-10-30 14:54:21,962 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=7eb2f68b4253f0defd394f12e58a84a8, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:54:22,113 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=7eb2f68b4253f0defd394f12e58a84a8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:22,114 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698677662113"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677662113"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677662113"}]},"ts":"1698677662113"} 2023-10-30 14:54:22,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 7eb2f68b4253f0defd394f12e58a84a8, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:22,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 14:54:22,270 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:22,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8. 2023-10-30 14:54:22,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7eb2f68b4253f0defd394f12e58a84a8, NAME => 'testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8.', STARTKEY => '', ENDKEY => ''} 2023-10-30 14:54:22,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-10-30 14:54:22,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-10-30 14:54:22,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 7eb2f68b4253f0defd394f12e58a84a8 2023-10-30 14:54:22,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:22,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7eb2f68b4253f0defd394f12e58a84a8 2023-10-30 14:54:22,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7eb2f68b4253f0defd394f12e58a84a8 2023-10-30 14:54:22,282 INFO [StoreOpener-7eb2f68b4253f0defd394f12e58a84a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7eb2f68b4253f0defd394f12e58a84a8 2023-10-30 14:54:22,283 DEBUG [StoreOpener-7eb2f68b4253f0defd394f12e58a84a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1 2023-10-30 14:54:22,283 DEBUG [StoreOpener-7eb2f68b4253f0defd394f12e58a84a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1 2023-10-30 14:54:22,284 INFO [StoreOpener-7eb2f68b4253f0defd394f12e58a84a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7eb2f68b4253f0defd394f12e58a84a8 columnFamilyName f1 2023-10-30 14:54:22,285 INFO [StoreOpener-7eb2f68b4253f0defd394f12e58a84a8-1] regionserver.HStore(310): Store=7eb2f68b4253f0defd394f12e58a84a8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:22,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8 2023-10-30 14:54:22,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8 2023-10-30 14:54:22,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7eb2f68b4253f0defd394f12e58a84a8 2023-10-30 14:54:22,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:54:22,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7eb2f68b4253f0defd394f12e58a84a8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66455484, jitterRate=-0.009736120700836182}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 14:54:22,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7eb2f68b4253f0defd394f12e58a84a8: 2023-10-30 14:54:22,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8., pid=73, masterSystemTime=1698677662270 2023-10-30 14:54:22,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8. 2023-10-30 14:54:22,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8. 2023-10-30 14:54:22,292 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=7eb2f68b4253f0defd394f12e58a84a8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:22,292 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698677662292"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677662292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677662292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677662292"}]},"ts":"1698677662292"} 2023-10-30 14:54:22,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-10-30 14:54:22,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 7eb2f68b4253f0defd394f12e58a84a8, server=jenkins-hbase20.apache.org,36359,1698677568317 in 177 msec 2023-10-30 14:54:22,296 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-30 14:54:22,296 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=7eb2f68b4253f0defd394f12e58a84a8, ASSIGN in 336 msec 2023-10-30 14:54:22,296 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 14:54:22,297 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677662296"}]},"ts":"1698677662296"} 2023-10-30 14:54:22,297 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-10-30 14:54:22,300 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 14:54:22,301 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1850 sec 2023-10-30 14:54:23,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 14:54:23,227 INFO [Listener at localhost/34621] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-10-30 14:54:23,227 DEBUG [Listener at localhost/34621] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-10-30 14:54:23,232 INFO [Listener at localhost/34621] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-30 14:54:23,239 INFO [Listener at localhost/34621] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-10-30 14:54:23,239 INFO [Listener at localhost/34621] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-30 14:54:23,240 INFO [Listener at localhost/34621] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-10-30 14:54:23,244 INFO [Listener at localhost/34621] regionserver.HRegion(2745): Flushing 7eb2f68b4253f0defd394f12e58a84a8 1/1 column families, dataSize=37 B heapSize=368 B 2023-10-30 14:54:23,665 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310303bbc559cc4cb4d1383a7f58455800fbd to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310303bbc559cc4cb4d1383a7f58455800fbd 2023-10-30 14:54:23,673 INFO [Listener at localhost/34621] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/.tmp/f1/3ad7bc4ec82a4832812448c3bed94072 2023-10-30 14:54:23,679 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/.tmp/f1/3ad7bc4ec82a4832812448c3bed94072 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072 2023-10-30 14:54:23,685 INFO [Listener at localhost/34621] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072, entries=1, sequenceid=5, filesize=4.9 K 2023-10-30 14:54:23,687 INFO [Listener at localhost/34621] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 7eb2f68b4253f0defd394f12e58a84a8 in 443ms, sequenceid=5, compaction requested=false 2023-10-30 14:54:23,687 DEBUG [Listener at localhost/34621] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-10-30 14:54:23,688 DEBUG [Listener at localhost/34621] regionserver.HRegion(2446): Flush status journal for 7eb2f68b4253f0defd394f12e58a84a8: 2023-10-30 14:54:23,690 INFO [Listener at localhost/34621] regionserver.HRegion(2745): Flushing 7eb2f68b4253f0defd394f12e58a84a8 1/1 column families, dataSize=37 B heapSize=368 B 2023-10-30 14:54:24,111 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103016b2eb8de33c4cc1ab2f14c1b7ae5920 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023103016b2eb8de33c4cc1ab2f14c1b7ae5920 2023-10-30 14:54:24,308 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 14:54:24,520 INFO [Listener at localhost/34621] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/.tmp/f1/ae0c4a3f35d74923bd375e4afb1f45af 2023-10-30 14:54:24,529 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/.tmp/f1/ae0c4a3f35d74923bd375e4afb1f45af as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af 2023-10-30 14:54:24,536 INFO [Listener at localhost/34621] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af, entries=1, sequenceid=9, filesize=4.9 K 2023-10-30 14:54:24,536 INFO [Listener at localhost/34621] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 7eb2f68b4253f0defd394f12e58a84a8 in 846ms, sequenceid=9, compaction requested=false 2023-10-30 14:54:24,537 DEBUG [Listener at localhost/34621] regionserver.HRegion(2446): Flush status journal for 7eb2f68b4253f0defd394f12e58a84a8: 2023-10-30 14:54:24,538 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43911] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-10-30 14:54:24,539 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-30 14:54:24,540 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-30 14:54:24,540 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698678264540 2023-10-30 14:54:24,540 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:54:24,541 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 14:54:24,541 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-10-30 14:54:24,541 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-10-30 14:54:24,542 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] zookeeper.ReadOnlyZKClient(139): Connect 0x769d0204 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:54:24,590 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:24,590 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:24,618 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42862c93, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:54:24,619 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231030 for table='testGetAfterCompaction' and column='f1' 2023-10-30 14:54:24,640 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:24,641 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:24,691 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:24,692 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:24,743 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:24,743 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:24,794 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:24,794 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:24,846 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:24,846 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:24,898 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:24,898 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:24,949 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:24,950 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,001 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,001 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,053 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,054 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,105 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,105 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,157 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,157 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,209 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,209 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,261 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,261 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,313 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,313 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,365 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,365 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,417 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,417 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,467 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310308d3751a6e57341e18fe8898b0e45ef12 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310308d3751a6e57341e18fe8898b0e45ef12 2023-10-30 14:54:25,468 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,468 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,469 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testGetAfterCompaction' column='f1' 2023-10-30 14:54:25,483 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:54:25,484 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:54:25,490 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 14:54:25,492 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 14:54:25,502 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/f1/c9607a105486458580fdfef874ce62d7 first=Optional[r1] last=Optional[r2] 2023-10-30 14:54:25,502 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{f1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/f1/c9607a105486458580fdfef874ce62d7}] 2023-10-30 14:54:25,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/f1/c9607a105486458580fdfef874ce62d7 for inclusion in 7eb2f68b4253f0defd394f12e58a84a8/f1 2023-10-30 14:54:25,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-10-30 14:54:25,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:54:25,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 7eb2f68b4253f0defd394f12e58a84a8: 2023-10-30 14:54:25,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/f1/c9607a105486458580fdfef874ce62d7 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testGetAfterCompaction__gjqq9tjaudlapj77kdtfgqlmdc0o4el9f17aaigjm4kt4vrlbb64boc6alsg9r5t/f1/c9607a105486458580fdfef874ce62d7 2023-10-30 14:54:25,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testGetAfterCompaction__gjqq9tjaudlapj77kdtfgqlmdc0o4el9f17aaigjm4kt4vrlbb64boc6alsg9r5t/f1/c9607a105486458580fdfef874ce62d7 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_ 2023-10-30 14:54:25,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testGetAfterCompaction__gjqq9tjaudlapj77kdtfgqlmdc0o4el9f17aaigjm4kt4vrlbb64boc6alsg9r5t/f1/c9607a105486458580fdfef874ce62d7 into 7eb2f68b4253f0defd394f12e58a84a8/f1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_ - updating store file list. 2023-10-30 14:54:25,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_ into 7eb2f68b4253f0defd394f12e58a84a8/f1 2023-10-30 14:54:25,519 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testGetAfterCompaction__gjqq9tjaudlapj77kdtfgqlmdc0o4el9f17aaigjm4kt4vrlbb64boc6alsg9r5t/f1/c9607a105486458580fdfef874ce62d7 into 7eb2f68b4253f0defd394f12e58a84a8/f1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_) 2023-10-30 14:54:25,519 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,519 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:25,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testGetAfterCompaction__gjqq9tjaudlapj77kdtfgqlmdc0o4el9f17aaigjm4kt4vrlbb64boc6alsg9r5t/f1/c9607a105486458580fdfef874ce62d7 2023-10-30 14:54:25,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(1912): 7eb2f68b4253f0defd394f12e58a84a8/f1 is initiating minor compaction 2023-10-30 14:54:25,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@10378f5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-30 14:54:25,520 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7eb2f68b4253f0defd394f12e58a84a8/f1 in testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8. 2023-10-30 14:54:25,520 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/.tmp, totalSize=10.0 K 2023-10-30 14:54:25,521 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting ae0c4a3f35d74923bd375e4afb1f45af, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 14:54:25,521 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 14:54:25,523 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testGetAfterCompaction' column='f1' 2023-10-30 14:54:25,524 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:25,525 DEBUG [Listener at localhost/34621] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-30 14:54:25,530 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58498, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-30 14:54:25,530 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023103016b2eb8de33c4cc1ab2f14c1b7ae5920 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023103016b2eb8de33c4cc1ab2f14c1b7ae5920 2023-10-30 14:54:25,531 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36359] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8. 2023-10-30 14:54:25,531 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36359] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-10-30 14:54:25,531 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36359] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-30 14:54:25,531 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36359] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-30 14:54:25,532 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36359] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8. because compaction request was cancelled 2023-10-30 14:54:25,532 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310303bbc559cc4cb4d1383a7f58455800fbd to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310303bbc559cc4cb4d1383a7f58455800fbd 2023-10-30 14:54:25,532 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-10-30 14:54:25,532 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231030' 2023-10-30 14:54:25,532 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231030 for table='testGetAfterCompaction' and column='f1' 2023-10-30 14:54:25,532 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-10-30 14:54:25,532 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:54:25,535 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-30 14:54:25,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 997 msec 2023-10-30 14:54:25,537 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7eb2f68b4253f0defd394f12e58a84a8#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:54:25,583 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,583 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,583 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:25,634 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,634 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,634 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:25,685 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,685 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,685 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:25,736 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,737 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,737 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:25,788 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,788 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,788 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:25,839 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,839 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,839 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:25,890 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,890 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,890 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:25,940 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,940 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,941 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:25,992 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,992 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:25,992 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:26,044 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,044 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,044 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:26,096 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,096 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,096 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:26,148 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,148 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,148 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:26,200 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,200 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,200 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:26,252 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,252 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,252 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:26,303 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,303 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,303 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:26,354 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,354 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,354 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:26,358 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/.tmp/f1/4e4333be00e74c518725ca1a9ddc3ecf as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/4e4333be00e74c518725ca1a9ddc3ecf 2023-10-30 14:54:26,366 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 7eb2f68b4253f0defd394f12e58a84a8/f1 of 7eb2f68b4253f0defd394f12e58a84a8 into 4e4333be00e74c518725ca1a9ddc3ecf(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:54:26,366 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7eb2f68b4253f0defd394f12e58a84a8: 2023-10-30 14:54:26,366 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1698677665520; duration=0sec 2023-10-30 14:54:26,366 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:54:26,405 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,405 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/4e4333be00e74c518725ca1a9ddc3ecf; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698677666349; access_time=1698677665531; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,406 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677664519; access_time=1698677663693; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,406 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698677665455; access_time=1698677664639; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 14:54:26,423 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_] to archive 2023-10-30 14:54:26,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:26,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/ae0c4a3f35d74923bd375e4afb1f45af 2023-10-30 14:54:26,429 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/cf1948b7bf5245169c1c4ef8d22cbae1_SeqId_12_ 2023-10-30 14:54:26,457 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698677663672; access_time=1698677663247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,457 INFO [Listener at localhost/34621] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/4e4333be00e74c518725ca1a9ddc3ecf; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698677666349; access_time=1698677665531; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 14:54:26,589 INFO [Listener at localhost/34621] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-10-30 14:54:26,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testGetAfterCompaction 2023-10-30 14:54:26,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-10-30 14:54:26,602 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677666602"}]},"ts":"1698677666602"} 2023-10-30 14:54:26,603 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-10-30 14:54:26,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-30 14:54:26,604 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-10-30 14:54:26,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=7eb2f68b4253f0defd394f12e58a84a8, UNASSIGN}] 2023-10-30 14:54:26,606 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=7eb2f68b4253f0defd394f12e58a84a8, UNASSIGN 2023-10-30 14:54:26,607 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=7eb2f68b4253f0defd394f12e58a84a8, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:26,607 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698677666607"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677666607"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677666607"}]},"ts":"1698677666607"} 2023-10-30 14:54:26,608 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 7eb2f68b4253f0defd394f12e58a84a8, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:26,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-30 14:54:26,760 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:26,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 7eb2f68b4253f0defd394f12e58a84a8 2023-10-30 14:54:26,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7eb2f68b4253f0defd394f12e58a84a8, disabling compactions & flushes 2023-10-30 14:54:26,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8. 2023-10-30 14:54:26,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8. 2023-10-30 14:54:26,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8. after waiting 0 ms 2023-10-30 14:54:26,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8. 2023-10-30 14:54:26,775 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 14:54:26,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-10-30 14:54:26,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-10-30 14:54:26,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8. 2023-10-30 14:54:26,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7eb2f68b4253f0defd394f12e58a84a8: 2023-10-30 14:54:26,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 7eb2f68b4253f0defd394f12e58a84a8 2023-10-30 14:54:26,780 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=7eb2f68b4253f0defd394f12e58a84a8, regionState=CLOSED 2023-10-30 14:54:26,780 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698677666780"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677666780"}]},"ts":"1698677666780"} 2023-10-30 14:54:26,783 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-30 14:54:26,783 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 7eb2f68b4253f0defd394f12e58a84a8, server=jenkins-hbase20.apache.org,36359,1698677568317 in 173 msec 2023-10-30 14:54:26,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-10-30 14:54:26,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=7eb2f68b4253f0defd394f12e58a84a8, UNASSIGN in 177 msec 2023-10-30 14:54:26,785 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677666785"}]},"ts":"1698677666785"} 2023-10-30 14:54:26,786 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-10-30 14:54:26,787 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-10-30 14:54:26,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 193 msec 2023-10-30 14:54:26,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-30 14:54:26,907 INFO [Listener at localhost/34621] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-10-30 14:54:26,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testGetAfterCompaction 2023-10-30 14:54:26,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 14:54:26,922 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 14:54:26,923 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 14:54:26,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-10-30 14:54:26,926 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8 2023-10-30 14:54:26,928 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1, FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/recovered.edits] 2023-10-30 14:54:26,932 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/3ad7bc4ec82a4832812448c3bed94072 2023-10-30 14:54:26,933 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/4e4333be00e74c518725ca1a9ddc3ecf to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/f1/4e4333be00e74c518725ca1a9ddc3ecf 2023-10-30 14:54:26,936 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/recovered.edits/15.seqid to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8/recovered.edits/15.seqid 2023-10-30 14:54:26,937 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testGetAfterCompaction/7eb2f68b4253f0defd394f12e58a84a8 2023-10-30 14:54:26,937 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-10-30 14:54:26,937 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-10-30 14:54:26,938 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-10-30 14:54:26,940 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310308d3751a6e57341e18fe8898b0e45ef12 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310308d3751a6e57341e18fe8898b0e45ef12 2023-10-30 14:54:26,941 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-10-30 14:54:26,942 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 14:54:26,960 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-10-30 14:54:26,962 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-10-30 14:54:26,963 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 14:54:26,963 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-10-30 14:54:26,963 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698677666963"}]},"ts":"9223372036854775807"} 2023-10-30 14:54:26,965 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-30 14:54:26,965 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7eb2f68b4253f0defd394f12e58a84a8, NAME => 'testGetAfterCompaction,,1698677661114.7eb2f68b4253f0defd394f12e58a84a8.', STARTKEY => '', ENDKEY => ''}] 2023-10-30 14:54:26,965 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-10-30 14:54:26,965 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1698677666965"}]},"ts":"9223372036854775807"} 2023-10-30 14:54:26,966 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-10-30 14:54:26,968 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 14:54:26,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 51 msec 2023-10-30 14:54:27,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-10-30 14:54:27,027 INFO [Listener at localhost/34621] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-10-30 14:54:27,044 INFO [Listener at localhost/34621] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=246 (was 243) - Thread LEAK? -, OpenFileDescriptor=626 (was 624) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=310 (was 340), ProcessCount=168 (was 168), AvailableMemoryMB=1655 (was 1656) 2023-10-30 14:54:27,056 INFO [Listener at localhost/34621] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=246, OpenFileDescriptor=626, MaxFileDescriptor=60000, SystemLoadAverage=310, ProcessCount=168, AvailableMemoryMB=1654 2023-10-30 14:54:27,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-30 14:54:27,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-10-30 14:54:27,061 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 14:54:27,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-10-30 14:54:27,062 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 14:54:27,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-30 14:54:27,064 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:27,064 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:27,065 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:27,065 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593 empty. 2023-10-30 14:54:27,066 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab empty. 2023-10-30 14:54:27,066 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b empty. 2023-10-30 14:54:27,066 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:27,066 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:27,067 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:27,067 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-10-30 14:54:27,075 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-10-30 14:54:27,076 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => ae1fa8048a3a8e4b39683c8300846593, NAME => 'testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:54:27,077 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => bb4420255160505884d9c82dfe0aed2b, NAME => 'testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:54:27,077 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 177e982e175e289e7a05a97bd09698ab, NAME => 'testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:54:27,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-30 14:54:27,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-30 14:54:27,490 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:27,490 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:27,490 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing ae1fa8048a3a8e4b39683c8300846593, disabling compactions & flushes 2023-10-30 14:54:27,491 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 177e982e175e289e7a05a97bd09698ab, disabling compactions & flushes 2023-10-30 14:54:27,491 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:27,491 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:27,491 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. after waiting 0 ms 2023-10-30 14:54:27,491 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:27,491 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:27,492 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:27,491 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:27,492 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 177e982e175e289e7a05a97bd09698ab: 2023-10-30 14:54:27,492 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. after waiting 0 ms 2023-10-30 14:54:27,492 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:27,492 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:27,493 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for ae1fa8048a3a8e4b39683c8300846593: 2023-10-30 14:54:27,493 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:27,493 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing bb4420255160505884d9c82dfe0aed2b, disabling compactions & flushes 2023-10-30 14:54:27,494 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:27,494 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:27,494 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. after waiting 0 ms 2023-10-30 14:54:27,494 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:27,494 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:27,494 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for bb4420255160505884d9c82dfe0aed2b: 2023-10-30 14:54:27,499 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 14:54:27,500 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698677667500"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677667500"}]},"ts":"1698677667500"} 2023-10-30 14:54:27,500 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698677667500"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677667500"}]},"ts":"1698677667500"} 2023-10-30 14:54:27,500 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698677667500"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677667500"}]},"ts":"1698677667500"} 2023-10-30 14:54:27,503 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-30 14:54:27,504 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 14:54:27,504 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677667504"}]},"ts":"1698677667504"} 2023-10-30 14:54:27,505 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-10-30 14:54:27,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ae1fa8048a3a8e4b39683c8300846593, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb4420255160505884d9c82dfe0aed2b, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=177e982e175e289e7a05a97bd09698ab, ASSIGN}] 2023-10-30 14:54:27,511 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ae1fa8048a3a8e4b39683c8300846593, ASSIGN 2023-10-30 14:54:27,512 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=177e982e175e289e7a05a97bd09698ab, ASSIGN 2023-10-30 14:54:27,512 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb4420255160505884d9c82dfe0aed2b, ASSIGN 2023-10-30 14:54:27,512 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ae1fa8048a3a8e4b39683c8300846593, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:54:27,512 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=177e982e175e289e7a05a97bd09698ab, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:54:27,512 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb4420255160505884d9c82dfe0aed2b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:54:27,666 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=ae1fa8048a3a8e4b39683c8300846593, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:27,666 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=bb4420255160505884d9c82dfe0aed2b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:27,666 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=177e982e175e289e7a05a97bd09698ab, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:27,666 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698677667665"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677667665"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677667665"}]},"ts":"1698677667665"} 2023-10-30 14:54:27,666 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698677667665"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677667665"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677667665"}]},"ts":"1698677667665"} 2023-10-30 14:54:27,666 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698677667665"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677667665"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677667665"}]},"ts":"1698677667665"} 2023-10-30 14:54:27,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-30 14:54:27,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure ae1fa8048a3a8e4b39683c8300846593, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:27,670 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure bb4420255160505884d9c82dfe0aed2b, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:27,674 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure 177e982e175e289e7a05a97bd09698ab, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:27,824 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:27,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:27,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 177e982e175e289e7a05a97bd09698ab, NAME => 'testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.', STARTKEY => '2', ENDKEY => ''} 2023-10-30 14:54:27,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:27,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:27,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:27,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:27,834 INFO [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:27,836 DEBUG [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1 2023-10-30 14:54:27,836 DEBUG [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1 2023-10-30 14:54:27,837 INFO [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 177e982e175e289e7a05a97bd09698ab columnFamilyName family1 2023-10-30 14:54:27,839 INFO [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] regionserver.HStore(310): Store=177e982e175e289e7a05a97bd09698ab/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:27,839 INFO [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:27,841 DEBUG [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2 2023-10-30 14:54:27,841 DEBUG [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2 2023-10-30 14:54:27,841 INFO [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 177e982e175e289e7a05a97bd09698ab columnFamilyName family2 2023-10-30 14:54:27,842 INFO [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] regionserver.HStore(310): Store=177e982e175e289e7a05a97bd09698ab/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:27,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:27,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:27,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 14:54:27,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:27,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:54:27,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 177e982e175e289e7a05a97bd09698ab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74984090, jitterRate=0.1173500120639801}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 14:54:27,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 177e982e175e289e7a05a97bd09698ab: 2023-10-30 14:54:27,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab., pid=85, masterSystemTime=1698677667824 2023-10-30 14:54:27,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:27,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:27,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:27,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ae1fa8048a3a8e4b39683c8300846593, NAME => 'testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.', STARTKEY => '', ENDKEY => '1'} 2023-10-30 14:54:27,852 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=177e982e175e289e7a05a97bd09698ab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:27,853 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698677667852"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677667852"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677667852"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677667852"}]},"ts":"1698677667852"} 2023-10-30 14:54:27,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:27,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:27,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:27,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:27,855 INFO [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:27,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=82 2023-10-30 14:54:27,856 DEBUG [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1 2023-10-30 14:54:27,856 DEBUG [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1 2023-10-30 14:54:27,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure 177e982e175e289e7a05a97bd09698ab, server=jenkins-hbase20.apache.org,36359,1698677568317 in 182 msec 2023-10-30 14:54:27,857 INFO [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae1fa8048a3a8e4b39683c8300846593 columnFamilyName family1 2023-10-30 14:54:27,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=177e982e175e289e7a05a97bd09698ab, ASSIGN in 347 msec 2023-10-30 14:54:27,858 INFO [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] regionserver.HStore(310): Store=ae1fa8048a3a8e4b39683c8300846593/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:27,858 INFO [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:27,860 DEBUG [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2 2023-10-30 14:54:27,860 DEBUG [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2 2023-10-30 14:54:27,861 INFO [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae1fa8048a3a8e4b39683c8300846593 columnFamilyName family2 2023-10-30 14:54:27,862 INFO [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] regionserver.HStore(310): Store=ae1fa8048a3a8e4b39683c8300846593/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:27,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:27,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:27,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 14:54:27,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:27,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:54:27,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ae1fa8048a3a8e4b39683c8300846593; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72861956, jitterRate=0.0857277512550354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 14:54:27,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ae1fa8048a3a8e4b39683c8300846593: 2023-10-30 14:54:27,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593., pid=83, masterSystemTime=1698677667824 2023-10-30 14:54:27,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:27,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:27,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:27,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb4420255160505884d9c82dfe0aed2b, NAME => 'testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.', STARTKEY => '1', ENDKEY => '2'} 2023-10-30 14:54:27,870 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=ae1fa8048a3a8e4b39683c8300846593, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:27,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:27,870 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698677667870"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677667870"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677667870"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677667870"}]},"ts":"1698677667870"} 2023-10-30 14:54:27,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:27,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:27,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:27,871 INFO [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:27,872 DEBUG [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1 2023-10-30 14:54:27,872 DEBUG [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1 2023-10-30 14:54:27,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=80 2023-10-30 14:54:27,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure ae1fa8048a3a8e4b39683c8300846593, server=jenkins-hbase20.apache.org,36359,1698677568317 in 202 msec 2023-10-30 14:54:27,873 INFO [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb4420255160505884d9c82dfe0aed2b columnFamilyName family1 2023-10-30 14:54:27,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ae1fa8048a3a8e4b39683c8300846593, ASSIGN in 364 msec 2023-10-30 14:54:27,873 INFO [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] regionserver.HStore(310): Store=bb4420255160505884d9c82dfe0aed2b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:27,873 INFO [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:27,874 DEBUG [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2 2023-10-30 14:54:27,874 DEBUG [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2 2023-10-30 14:54:27,875 INFO [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb4420255160505884d9c82dfe0aed2b columnFamilyName family2 2023-10-30 14:54:27,875 INFO [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] regionserver.HStore(310): Store=bb4420255160505884d9c82dfe0aed2b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:27,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:27,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:27,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 14:54:27,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:27,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:54:27,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened bb4420255160505884d9c82dfe0aed2b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60789011, jitterRate=-0.09417314827442169}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 14:54:27,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for bb4420255160505884d9c82dfe0aed2b: 2023-10-30 14:54:27,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b., pid=84, masterSystemTime=1698677667824 2023-10-30 14:54:27,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:27,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:27,882 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=bb4420255160505884d9c82dfe0aed2b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:27,883 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698677667882"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677667882"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677667882"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677667882"}]},"ts":"1698677667882"} 2023-10-30 14:54:27,885 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=81 2023-10-30 14:54:27,885 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure bb4420255160505884d9c82dfe0aed2b, server=jenkins-hbase20.apache.org,36359,1698677568317 in 214 msec 2023-10-30 14:54:27,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=79 2023-10-30 14:54:27,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb4420255160505884d9c82dfe0aed2b, ASSIGN in 377 msec 2023-10-30 14:54:27,887 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 14:54:27,888 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677667888"}]},"ts":"1698677667888"} 2023-10-30 14:54:27,889 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-10-30 14:54:27,891 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 14:54:27,892 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 832 msec 2023-10-30 14:54:28,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-30 14:54:28,170 INFO [Listener at localhost/34621] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-10-30 14:54:28,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:28,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:28,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:28,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:28,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-30 14:54:28,189 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-30 14:54:28,189 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:28,189 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-30 14:54:28,189 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-30 14:54:28,189 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:28,189 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:28,190 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:28,190 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:28,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:28,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:28,191 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:28,191 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:28,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:28,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:28,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:28,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:28,192 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-30 14:54:28,193 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-30 14:54:28,193 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-30 14:54:28,193 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:28,193 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-30 14:54:28,193 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:28,194 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. started... 2023-10-30 14:54:28,198 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 177e982e175e289e7a05a97bd09698ab 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 14:54:28,198 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:28,198 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 14:54:28,198 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:28,198 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. started... 2023-10-30 14:54:28,199 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. started... 2023-10-30 14:54:28,198 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:28,199 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ae1fa8048a3a8e4b39683c8300846593 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 14:54:28,199 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bb4420255160505884d9c82dfe0aed2b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 14:54:28,625 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030d4476e19c8584a6ba1a6034376399e72 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030d4476e19c8584a6ba1a6034376399e72 2023-10-30 14:54:28,625 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030d85f81458f234c52accfe89b5cc77d13 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030d85f81458f234c52accfe89b5cc77d13 2023-10-30 14:54:28,626 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310305d4c36e04d25494ebee0c2aca172e077 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310305d4c36e04d25494ebee0c2aca172e077 2023-10-30 14:54:29,032 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family1/295e1e182a8645f2b8e4c0bbbd048585 2023-10-30 14:54:29,035 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family1/2b47a1baeecd4aa1ad0a3c96868a7d18 2023-10-30 14:54:29,035 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family1/759e3982aa854502a1ce7acd8e912e27 2023-10-30 14:54:29,459 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030e8d2f245f5744ce3b46aa355a2b27cb2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030e8d2f245f5744ce3b46aa355a2b27cb2 2023-10-30 14:54:29,459 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030791e633deb98414c93b811cadfb7a168 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030791e633deb98414c93b811cadfb7a168 2023-10-30 14:54:29,459 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030ea4d8161e3aa4ce68f1fca34a2462d2b to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030ea4d8161e3aa4ce68f1fca34a2462d2b 2023-10-30 14:54:29,866 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family2/a894379bbf574430a9752a8e8fe13ea4 2023-10-30 14:54:29,873 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family2/53bcf2454ffe4417923cc96b7a80572d 2023-10-30 14:54:29,874 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family2/581a155e7d464babbdeafdaab27919b1 2023-10-30 14:54:29,878 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family1/295e1e182a8645f2b8e4c0bbbd048585 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/295e1e182a8645f2b8e4c0bbbd048585 2023-10-30 14:54:29,881 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family1/2b47a1baeecd4aa1ad0a3c96868a7d18 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/2b47a1baeecd4aa1ad0a3c96868a7d18 2023-10-30 14:54:29,882 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family1/759e3982aa854502a1ce7acd8e912e27 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/759e3982aa854502a1ce7acd8e912e27 2023-10-30 14:54:29,885 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/295e1e182a8645f2b8e4c0bbbd048585, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 14:54:29,886 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family2/a894379bbf574430a9752a8e8fe13ea4 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/a894379bbf574430a9752a8e8fe13ea4 2023-10-30 14:54:29,887 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/2b47a1baeecd4aa1ad0a3c96868a7d18, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 14:54:29,888 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/759e3982aa854502a1ce7acd8e912e27, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 14:54:29,888 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family2/53bcf2454ffe4417923cc96b7a80572d as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/53bcf2454ffe4417923cc96b7a80572d 2023-10-30 14:54:29,888 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family2/581a155e7d464babbdeafdaab27919b1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/581a155e7d464babbdeafdaab27919b1 2023-10-30 14:54:29,890 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/a894379bbf574430a9752a8e8fe13ea4, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 14:54:29,891 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ae1fa8048a3a8e4b39683c8300846593 in 1692ms, sequenceid=5, compaction requested=false 2023-10-30 14:54:29,891 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-10-30 14:54:29,891 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ae1fa8048a3a8e4b39683c8300846593: 2023-10-30 14:54:29,891 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:29,891 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 14:54:29,892 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/53bcf2454ffe4417923cc96b7a80572d, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 14:54:29,893 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 177e982e175e289e7a05a97bd09698ab in 1695ms, sequenceid=5, compaction requested=false 2023-10-30 14:54:29,893 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 177e982e175e289e7a05a97bd09698ab: 2023-10-30 14:54:29,893 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:29,893 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/581a155e7d464babbdeafdaab27919b1, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 14:54:29,893 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 14:54:29,894 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for bb4420255160505884d9c82dfe0aed2b in 1695ms, sequenceid=5, compaction requested=false 2023-10-30 14:54:29,894 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bb4420255160505884d9c82dfe0aed2b: 2023-10-30 14:54:29,894 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:29,894 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 14:54:29,894 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 14:54:29,894 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:29,895 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-30 14:54:29,895 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-30 14:54:29,896 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:29,896 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:29,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:29,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:29,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:29,896 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:29,896 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:29,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:29,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:29,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:29,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:29,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:29,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-30 14:54:29,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77676e43[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:29,897 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-30 14:54:29,898 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:29,898 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:29,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:29,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:29,898 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-30 14:54:29,898 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-30 14:54:29,898 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:29,898 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:29,898 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:29,899 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:29,899 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-30 14:54:29,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:29,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:29,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:29,899 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:29,900 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-30 14:54:29,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:29,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:29,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:29,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:29,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:29,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:29,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:29,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:29,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-30 14:54:29,902 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-30 14:54:29,902 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:29,902 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:29,902 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-30 14:54:29,902 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:29,903 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:29,903 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:29,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:29,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:29,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:29,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:29,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:29,903 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:29,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:29,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:29,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:29,903 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:29,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:29,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:29,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:29,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:29,905 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:29,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:29,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:29,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:29,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:29,907 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:29,907 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:29,907 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:29,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:29,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-30 14:54:29,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:29,907 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:29,907 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:29,907 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:29,907 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:29,907 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:29,907 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:29,907 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:29,907 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:29,907 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:29,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-30 14:54:29,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:29,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:29,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:30,007 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:30,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:30,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:30,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:30,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:30,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:30,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-30 14:54:30,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-30 14:54:30,024 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-30 14:54:30,024 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:30,024 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-30 14:54:30,024 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-30 14:54:30,025 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:30,025 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:30,026 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:30,026 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:30,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:30,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:30,027 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:30,027 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:30,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:30,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:30,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:30,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:30,028 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-30 14:54:30,028 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-30 14:54:30,028 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-30 14:54:30,028 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-30 14:54:30,029 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:30,029 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-30 14:54:30,029 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:30,029 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. started... 2023-10-30 14:54:30,029 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:30,029 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 14:54:30,029 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:30,029 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. started... 2023-10-30 14:54:30,029 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 177e982e175e289e7a05a97bd09698ab 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 14:54:30,029 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:30,029 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. started... 2023-10-30 14:54:30,029 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bb4420255160505884d9c82dfe0aed2b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 14:54:30,029 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ae1fa8048a3a8e4b39683c8300846593 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 14:54:30,453 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030652fa08d7eaa489aa53112a25e4c6e52 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030652fa08d7eaa489aa53112a25e4c6e52 2023-10-30 14:54:30,453 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103081d39d6093c24c6089bddb6c87ad0027 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023103081d39d6093c24c6089bddb6c87ad0027 2023-10-30 14:54:30,454 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030f6643351702042038f9dd4acd6531b12 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030f6643351702042038f9dd4acd6531b12 2023-10-30 14:54:30,860 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family1/ea958de57c9f4ab68aced0e68b1dc78e 2023-10-30 14:54:30,860 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family1/b598326d3877443f8a5c2ce183ba1ced 2023-10-30 14:54:30,860 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family1/aa621a482a484c03adc30abe5de75ad6 2023-10-30 14:54:31,291 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030f33973934ce04cf78eb06ec5d534f99f to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030f33973934ce04cf78eb06ec5d534f99f 2023-10-30 14:54:31,291 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103057b53ec6a60f4484a8d7572c7206f4e1 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103057b53ec6a60f4484a8d7572c7206f4e1 2023-10-30 14:54:31,291 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103052fd2e67195e4f6f9006d3325678bf5c to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103052fd2e67195e4f6f9006d3325678bf5c 2023-10-30 14:54:31,699 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family2/54b63ff7f107495b9b03d1485db0e3c4 2023-10-30 14:54:31,699 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family2/32bfccbe5e7f4ffa98cc1d1b8f0aa0d5 2023-10-30 14:54:31,701 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family2/401ae32ee6274f79bd17dc7a11d6b617 2023-10-30 14:54:31,710 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family1/aa621a482a484c03adc30abe5de75ad6 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/aa621a482a484c03adc30abe5de75ad6 2023-10-30 14:54:31,710 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family1/b598326d3877443f8a5c2ce183ba1ced as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/b598326d3877443f8a5c2ce183ba1ced 2023-10-30 14:54:31,711 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family1/ea958de57c9f4ab68aced0e68b1dc78e as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/ea958de57c9f4ab68aced0e68b1dc78e 2023-10-30 14:54:31,715 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/b598326d3877443f8a5c2ce183ba1ced, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 14:54:31,715 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/aa621a482a484c03adc30abe5de75ad6, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 14:54:31,715 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/ea958de57c9f4ab68aced0e68b1dc78e, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 14:54:31,716 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family2/32bfccbe5e7f4ffa98cc1d1b8f0aa0d5 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/32bfccbe5e7f4ffa98cc1d1b8f0aa0d5 2023-10-30 14:54:31,716 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family2/54b63ff7f107495b9b03d1485db0e3c4 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/54b63ff7f107495b9b03d1485db0e3c4 2023-10-30 14:54:31,716 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family2/401ae32ee6274f79bd17dc7a11d6b617 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/401ae32ee6274f79bd17dc7a11d6b617 2023-10-30 14:54:31,720 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/401ae32ee6274f79bd17dc7a11d6b617, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 14:54:31,720 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/32bfccbe5e7f4ffa98cc1d1b8f0aa0d5, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 14:54:31,720 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/54b63ff7f107495b9b03d1485db0e3c4, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 14:54:31,721 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 177e982e175e289e7a05a97bd09698ab in 1692ms, sequenceid=9, compaction requested=false 2023-10-30 14:54:31,721 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for bb4420255160505884d9c82dfe0aed2b in 1692ms, sequenceid=9, compaction requested=false 2023-10-30 14:54:31,721 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ae1fa8048a3a8e4b39683c8300846593 in 1692ms, sequenceid=9, compaction requested=false 2023-10-30 14:54:31,721 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bb4420255160505884d9c82dfe0aed2b: 2023-10-30 14:54:31,721 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 177e982e175e289e7a05a97bd09698ab: 2023-10-30 14:54:31,721 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:31,721 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ae1fa8048a3a8e4b39683c8300846593: 2023-10-30 14:54:31,721 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:31,721 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 14:54:31,721 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:31,721 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 14:54:31,721 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 14:54:31,721 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 14:54:31,721 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:31,721 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-30 14:54:31,721 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-30 14:54:31,722 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:31,722 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:31,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:31,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:31,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:31,723 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:31,723 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:31,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:31,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:31,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:31,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:31,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:31,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-30 14:54:31,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2115ad35[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:31,724 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-30 14:54:31,724 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:31,725 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:31,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:31,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:31,725 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-30 14:54:31,725 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-30 14:54:31,725 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:31,725 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:31,725 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:31,726 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:31,726 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-30 14:54:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:31,726 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:31,726 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-30 14:54:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:31,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:31,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:31,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:31,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:31,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-30 14:54:31,729 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-30 14:54:31,729 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:31,729 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:31,729 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-30 14:54:31,729 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:31,730 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:31,730 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:31,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:31,730 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:31,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:31,731 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:31,732 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:31,733 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:31,733 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:31,734 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:31,734 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:31,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-30 14:54:31,734 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:31,734 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:31,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:31,734 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:31,734 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:31,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:31,734 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:31,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:31,734 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:31,734 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:31,734 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:31,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:31,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:31,835 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:31,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:31,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:31,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:31,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:31,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:31,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-30 14:54:31,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-30 14:54:31,848 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-30 14:54:31,849 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:31,849 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-30 14:54:31,849 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-30 14:54:31,849 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:31,849 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:31,850 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:31,850 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:31,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:31,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:31,851 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:31,851 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:31,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:31,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:31,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:31,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:31,852 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-30 14:54:31,852 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-30 14:54:31,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-30 14:54:31,852 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-30 14:54:31,852 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:31,852 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-30 14:54:31,852 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:31,852 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:31,852 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 14:54:31,852 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:31,852 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. started... 2023-10-30 14:54:31,852 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:31,852 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. started... 2023-10-30 14:54:31,852 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. started... 2023-10-30 14:54:31,852 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 177e982e175e289e7a05a97bd09698ab 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 14:54:31,852 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bb4420255160505884d9c82dfe0aed2b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 14:54:31,852 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ae1fa8048a3a8e4b39683c8300846593 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 14:54:32,270 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310301d84ee4c3d9b4d14a880aaa505aaffa5 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310301d84ee4c3d9b4d14a880aaa505aaffa5 2023-10-30 14:54:32,270 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103064f18b070bd6417b970ba5bf25812d1b to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023103064f18b070bd6417b970ba5bf25812d1b 2023-10-30 14:54:32,270 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030306a95190aca471bb3fb90e9afe4c1b6 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030306a95190aca471bb3fb90e9afe4c1b6 2023-10-30 14:54:32,279 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 14:54:32,677 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family1/ab92fff50dab4ae2982dd62a74c7a087 2023-10-30 14:54:32,678 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family1/f74278cae04e42c2964dcd29438480ca 2023-10-30 14:54:32,678 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family1/4808a5156fa94e7fae3d06858c38b36e 2023-10-30 14:54:32,799 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-10-30 14:54:32,803 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 14:54:32,803 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x769d0204 to 127.0.0.1:49804 2023-10-30 14:54:32,803 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:54:32,806 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53d55b96 to 127.0.0.1:49804 2023-10-30 14:54:32,806 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:54:32,808 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 14:54:32,808 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c7ce870 to 127.0.0.1:49804 2023-10-30 14:54:32,809 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:54:32,810 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 14:54:32,810 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f1ab284 to 127.0.0.1:49804 2023-10-30 14:54:32,810 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:54:32,824 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310302d3e6fd4fecc43f89661bda688f12df4 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310302d3e6fd4fecc43f89661bda688f12df4 2023-10-30 14:54:33,223 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310304d0a7814543843f59835dc40266c0b68 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310304d0a7814543843f59835dc40266c0b68 2023-10-30 14:54:33,224 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103094ab3781d55c4d569f11c57573387312 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103094ab3781d55c4d569f11c57573387312 2023-10-30 14:54:33,230 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family2/842819db31bd40db9555b648b51e83e3 2023-10-30 14:54:33,234 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family1/ab92fff50dab4ae2982dd62a74c7a087 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/ab92fff50dab4ae2982dd62a74c7a087 2023-10-30 14:54:33,238 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/ab92fff50dab4ae2982dd62a74c7a087, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 14:54:33,239 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family2/842819db31bd40db9555b648b51e83e3 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/842819db31bd40db9555b648b51e83e3 2023-10-30 14:54:33,242 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/842819db31bd40db9555b648b51e83e3, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 14:54:33,243 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 177e982e175e289e7a05a97bd09698ab in 1391ms, sequenceid=13, compaction requested=true 2023-10-30 14:54:33,243 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 177e982e175e289e7a05a97bd09698ab: 2023-10-30 14:54:33,243 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:33,244 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 14:54:33,628 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family2/2585357f0708418eb01e1e185092d495 2023-10-30 14:54:33,630 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family2/deff8397ffde4b2480faeb0b70f4f9c3 2023-10-30 14:54:33,639 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family1/4808a5156fa94e7fae3d06858c38b36e as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/4808a5156fa94e7fae3d06858c38b36e 2023-10-30 14:54:33,640 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family1/f74278cae04e42c2964dcd29438480ca as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/f74278cae04e42c2964dcd29438480ca 2023-10-30 14:54:33,644 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/4808a5156fa94e7fae3d06858c38b36e, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 14:54:33,644 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/f74278cae04e42c2964dcd29438480ca, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 14:54:33,645 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family2/2585357f0708418eb01e1e185092d495 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/2585357f0708418eb01e1e185092d495 2023-10-30 14:54:33,645 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family2/deff8397ffde4b2480faeb0b70f4f9c3 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/deff8397ffde4b2480faeb0b70f4f9c3 2023-10-30 14:54:33,649 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/2585357f0708418eb01e1e185092d495, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 14:54:33,649 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/deff8397ffde4b2480faeb0b70f4f9c3, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 14:54:33,650 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ae1fa8048a3a8e4b39683c8300846593 in 1798ms, sequenceid=13, compaction requested=true 2023-10-30 14:54:33,650 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for bb4420255160505884d9c82dfe0aed2b in 1798ms, sequenceid=13, compaction requested=true 2023-10-30 14:54:33,650 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ae1fa8048a3a8e4b39683c8300846593: 2023-10-30 14:54:33,650 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bb4420255160505884d9c82dfe0aed2b: 2023-10-30 14:54:33,650 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:33,650 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:33,650 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 14:54:33,650 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 14:54:33,650 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 14:54:33,650 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:33,650 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-30 14:54:33,650 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-30 14:54:33,652 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:33,652 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:33,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:33,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:33,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:33,653 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:33,653 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:33,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:33,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:33,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:33,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:33,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:33,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-30 14:54:33,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a6dc005[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:33,654 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-30 14:54:33,654 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:33,655 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:33,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:33,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:33,655 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-30 14:54:33,655 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-30 14:54:33,655 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:33,655 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:33,655 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:33,656 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-30 14:54:33,656 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:33,656 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:33,656 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-30 14:54:33,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:33,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:33,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:33,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:33,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:33,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:33,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-30 14:54:33,659 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-30 14:54:33,659 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:33,659 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:33,659 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-30 14:54:33,659 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:33,661 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:33,661 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:33,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:33,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:33,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:33,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:33,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:33,661 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:33,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:33,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:33,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:33,661 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:33,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:33,663 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:33,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:33,665 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:33,665 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:33,665 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:33,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:33,665 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:33,665 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:33,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-30 14:54:33,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:33,665 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:33,666 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:33,666 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:33,666 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:33,666 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:33,666 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:33,666 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:33,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:33,766 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:33,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:33,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:33,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:33,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:33,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:33,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-30 14:54:33,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-30 14:54:33,779 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-30 14:54:33,779 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:33,779 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-30 14:54:33,779 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-30 14:54:33,780 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:33,780 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:33,781 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:33,781 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:33,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:33,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:33,781 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:33,781 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:33,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:33,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:33,782 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-30 14:54:33,782 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-30 14:54:33,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-30 14:54:33,782 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-30 14:54:33,782 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:33,782 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-30 14:54:33,783 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:33,783 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:33,783 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 14:54:33,783 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:33,783 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. started... 2023-10-30 14:54:33,783 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. started... 2023-10-30 14:54:33,783 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:33,783 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. started... 2023-10-30 14:54:33,783 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 177e982e175e289e7a05a97bd09698ab 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 14:54:33,783 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ae1fa8048a3a8e4b39683c8300846593 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 14:54:33,783 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bb4420255160505884d9c82dfe0aed2b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 14:54:34,211 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310305b7e2588a2fd4fcf855be950885822ae to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310305b7e2588a2fd4fcf855be950885822ae 2023-10-30 14:54:34,211 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310306b07bd1b692b4ae08c74af088fe0fb4c to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310306b07bd1b692b4ae08c74af088fe0fb4c 2023-10-30 14:54:34,211 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030ad4c64c2896f4546ba4520b49f1c1bfe to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030ad4c64c2896f4546ba4520b49f1c1bfe 2023-10-30 14:54:34,619 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family1/cb4f7beb9e6145b69a78a38546bb4fc5 2023-10-30 14:54:34,619 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family1/ad30394daddd43ab8c1062194de0e1e9 2023-10-30 14:54:34,619 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family1/de1b296614cb4a1fbc6d3967bac55140 2023-10-30 14:54:34,638 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030d938a4ee2e9f4c97aff9b4533d19701d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030d938a4ee2e9f4c97aff9b4533d19701d 2023-10-30 14:54:35,043 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family2/49944bc1a53c4289b0eb4d14a1ba38a7 2023-10-30 14:54:35,046 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103046af05a6db584b00b23ab31e8a185b65 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103046af05a6db584b00b23ab31e8a185b65 2023-10-30 14:54:35,046 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103012f1a5e1fd2d4d70a013c31616b361e8 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103012f1a5e1fd2d4d70a013c31616b361e8 2023-10-30 14:54:35,048 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family1/ad30394daddd43ab8c1062194de0e1e9 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/ad30394daddd43ab8c1062194de0e1e9 2023-10-30 14:54:35,051 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family2/a71b6279cb934faf9d40886373be5d6d 2023-10-30 14:54:35,052 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family2/a37fba37977a400b9a368a162f1a8993 2023-10-30 14:54:35,053 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/ad30394daddd43ab8c1062194de0e1e9, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 14:54:35,054 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family2/49944bc1a53c4289b0eb4d14a1ba38a7 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/49944bc1a53c4289b0eb4d14a1ba38a7 2023-10-30 14:54:35,057 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family1/de1b296614cb4a1fbc6d3967bac55140 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/de1b296614cb4a1fbc6d3967bac55140 2023-10-30 14:54:35,057 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family1/cb4f7beb9e6145b69a78a38546bb4fc5 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/cb4f7beb9e6145b69a78a38546bb4fc5 2023-10-30 14:54:35,058 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/49944bc1a53c4289b0eb4d14a1ba38a7, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 14:54:35,059 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 177e982e175e289e7a05a97bd09698ab in 1276ms, sequenceid=17, compaction requested=true 2023-10-30 14:54:35,059 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 177e982e175e289e7a05a97bd09698ab: 2023-10-30 14:54:35,059 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:35,059 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 14:54:35,062 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/cb4f7beb9e6145b69a78a38546bb4fc5, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 14:54:35,062 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/de1b296614cb4a1fbc6d3967bac55140, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 14:54:35,062 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family2/a71b6279cb934faf9d40886373be5d6d as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/a71b6279cb934faf9d40886373be5d6d 2023-10-30 14:54:35,063 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family2/a37fba37977a400b9a368a162f1a8993 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/a37fba37977a400b9a368a162f1a8993 2023-10-30 14:54:35,066 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/a37fba37977a400b9a368a162f1a8993, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 14:54:35,066 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/a71b6279cb934faf9d40886373be5d6d, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 14:54:35,067 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ae1fa8048a3a8e4b39683c8300846593 in 1284ms, sequenceid=17, compaction requested=true 2023-10-30 14:54:35,067 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for bb4420255160505884d9c82dfe0aed2b in 1284ms, sequenceid=17, compaction requested=true 2023-10-30 14:54:35,067 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ae1fa8048a3a8e4b39683c8300846593: 2023-10-30 14:54:35,067 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bb4420255160505884d9c82dfe0aed2b: 2023-10-30 14:54:35,067 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:35,067 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:35,068 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 14:54:35,068 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 14:54:35,068 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 14:54:35,068 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,068 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-30 14:54:35,068 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-30 14:54:35,069 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:35,069 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:35,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:35,069 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:35,069 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:35,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:35,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:35,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:35,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:35,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-30 14:54:35,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4178833e[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:35,070 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-30 14:54:35,070 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:35,071 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:35,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:35,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:35,071 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-30 14:54:35,071 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-30 14:54:35,071 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:35,071 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,071 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:35,072 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-30 14:54:35,072 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,072 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:35,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:35,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:35,072 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-30 14:54:35,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:35,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:35,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:35,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:35,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:35,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:35,074 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-30 14:54:35,074 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:35,074 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:35,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-30 14:54:35,074 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-30 14:54:35,075 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:35,076 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:35,076 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:35,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:35,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:35,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:35,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:35,076 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:35,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:35,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:35,076 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:35,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:35,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:35,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:35,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:35,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:35,077 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:35,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:35,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,078 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,079 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:35,079 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:35,079 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:35,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:35,079 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:35,079 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,079 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:35,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:35,079 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:35,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-30 14:54:35,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:35,079 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:35,079 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:35,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:35,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:35,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-30 14:54:35,079 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:35,079 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:35,179 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:35,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:35,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb-1698677675181 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 14:54:35,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698677675190 (current time:1698677675190). 2023-10-30 14:54:35,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-30 14:54:35,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] zookeeper.ReadOnlyZKClient(139): Connect 0x58e86c64 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:54:35,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@169edc31, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:54:35,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:54:35,203 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:54:35,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58e86c64 to 127.0.0.1:49804 2023-10-30 14:54:35,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:54:35,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-30 14:54:35,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1698677675181 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 14:54:35,218 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.hbase-snapshot, current working dir path: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.hbase-snapshot/.tmp/snaptb-1698677675181 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-30 14:54:35,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 14:54:35,226 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 14:54:35,227 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698678275227 2023-10-30 14:54:35,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1698677675181 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 14:54:35,228 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1698677675181 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-10-30 14:54:35,229 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 14:54:35,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-30 14:54:35,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-10-30 14:54:35,231 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-30 14:54:35,231 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1698678275231 2023-10-30 14:54:35,234 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1698677675181 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:35,234 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-30 14:54:35,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1698677675181 2023-10-30 14:54:35,239 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1698677675181' 2023-10-30 14:54:35,239 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-30 14:54:35,239 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1698677675181' starting 'acquire' 2023-10-30 14:54:35,239 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1698677675181', kicking off acquire phase on members. 2023-10-30 14:54:35,240 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698677675181 2023-10-30 14:54:35,240 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1698677675181 2023-10-30 14:54:35,240 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-30 14:54:35,240 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1698677675181/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-30 14:54:35,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-30 14:54:35,241 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1698677675181/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,241 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:35,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1698677675181 2023-10-30 14:54:35,241 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698677675181 2023-10-30 14:54:35,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-10-30 14:54:35,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1698677675181 2023-10-30 14:54:35,241 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1698677675181 from table testCompactionWithHFileLink type FLUSH 2023-10-30 14:54:35,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1698677675181 2023-10-30 14:54:35,243 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1698677675181' with timeout 300000ms 2023-10-30 14:54:35,243 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-30 14:54:35,243 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1698677675181' starting 'acquire' stage 2023-10-30 14:54:35,243 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1698677675181' locally acquired 2023-10-30 14:54:35,243 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (snaptb-1698677675181) in zk 2023-10-30 14:54:35,244 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1698677675181 2023-10-30 14:54:35,244 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698677675181/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1698677675181/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:35,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-30 14:54:35,244 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698677675181 2023-10-30 14:54:35,245 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1698677675181' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:35,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:35,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:35,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698677675181 2023-10-30 14:54:35,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:35,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'snaptb-1698677675181' on coordinator 2023-10-30 14:54:35,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d21f824[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:35,246 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1698677675181' starting 'in-barrier' execution. 2023-10-30 14:54:35,246 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1698677675181 2023-10-30 14:54:35,246 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698677675181 2023-10-30 14:54:35,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1698677675181 2023-10-30 14:54:35,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1698677675181 2023-10-30 14:54:35,247 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1698677675181' received 'reached' from coordinator. 2023-10-30 14:54:35,247 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698677675181/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,247 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:35,250 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:35,250 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:35,250 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-10-30 14:54:35,250 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:35,250 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-30 14:54:35,251 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. started... 2023-10-30 14:54:35,251 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. started... 2023-10-30 14:54:35,251 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. started... 2023-10-30 14:54:35,251 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 177e982e175e289e7a05a97bd09698ab: 2023-10-30 14:54:35,251 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for bb4420255160505884d9c82dfe0aed2b: 2023-10-30 14:54:35,251 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for ae1fa8048a3a8e4b39683c8300846593: 2023-10-30 14:54:35,252 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.' region-info for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,252 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.' region-info for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,252 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.' region-info for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,256 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-30 14:54:35,256 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-30 14:54:35,256 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-30 14:54:35,259 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/295e1e182a8645f2b8e4c0bbbd048585, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/b598326d3877443f8a5c2ce183ba1ced, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/4808a5156fa94e7fae3d06858c38b36e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/de1b296614cb4a1fbc6d3967bac55140] hfiles 2023-10-30 14:54:35,259 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/759e3982aa854502a1ce7acd8e912e27, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/ea958de57c9f4ab68aced0e68b1dc78e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/f74278cae04e42c2964dcd29438480ca, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/cb4f7beb9e6145b69a78a38546bb4fc5] hfiles 2023-10-30 14:54:35,260 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/759e3982aa854502a1ce7acd8e912e27 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,259 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/2b47a1baeecd4aa1ad0a3c96868a7d18, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/aa621a482a484c03adc30abe5de75ad6, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/ab92fff50dab4ae2982dd62a74c7a087, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/ad30394daddd43ab8c1062194de0e1e9] hfiles 2023-10-30 14:54:35,259 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/295e1e182a8645f2b8e4c0bbbd048585 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,260 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/2b47a1baeecd4aa1ad0a3c96868a7d18 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,264 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/b598326d3877443f8a5c2ce183ba1ced for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,264 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/ea958de57c9f4ab68aced0e68b1dc78e for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,264 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/aa621a482a484c03adc30abe5de75ad6 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,264 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/f74278cae04e42c2964dcd29438480ca for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,264 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/4808a5156fa94e7fae3d06858c38b36e for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,264 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/cb4f7beb9e6145b69a78a38546bb4fc5 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,264 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/ab92fff50dab4ae2982dd62a74c7a087 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,264 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/ad30394daddd43ab8c1062194de0e1e9 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,264 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/de1b296614cb4a1fbc6d3967bac55140 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,264 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/581a155e7d464babbdeafdaab27919b1, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/401ae32ee6274f79bd17dc7a11d6b617, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/deff8397ffde4b2480faeb0b70f4f9c3, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/a71b6279cb934faf9d40886373be5d6d] hfiles 2023-10-30 14:54:35,264 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/581a155e7d464babbdeafdaab27919b1 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,264 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/53bcf2454ffe4417923cc96b7a80572d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/54b63ff7f107495b9b03d1485db0e3c4, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/842819db31bd40db9555b648b51e83e3, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/49944bc1a53c4289b0eb4d14a1ba38a7] hfiles 2023-10-30 14:54:35,265 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/401ae32ee6274f79bd17dc7a11d6b617 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,264 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/a894379bbf574430a9752a8e8fe13ea4, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/32bfccbe5e7f4ffa98cc1d1b8f0aa0d5, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/2585357f0708418eb01e1e185092d495, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/a37fba37977a400b9a368a162f1a8993] hfiles 2023-10-30 14:54:35,265 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/deff8397ffde4b2480faeb0b70f4f9c3 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,265 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/53bcf2454ffe4417923cc96b7a80572d for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,265 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/a71b6279cb934faf9d40886373be5d6d for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,265 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/a894379bbf574430a9752a8e8fe13ea4 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,265 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/54b63ff7f107495b9b03d1485db0e3c4 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,265 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/842819db31bd40db9555b648b51e83e3 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,265 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/49944bc1a53c4289b0eb4d14a1ba38a7 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,265 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/32bfccbe5e7f4ffa98cc1d1b8f0aa0d5 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,265 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/2585357f0708418eb01e1e185092d495 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,265 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/a37fba37977a400b9a368a162f1a8993 for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,277 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. completed. 2023-10-30 14:54:35,277 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:35,278 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. completed. 2023-10-30 14:54:35,278 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:35,278 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-10-30 14:54:35,278 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-10-30 14:54:35,334 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 14:54:35,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698677675181 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 14:54:35,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698677675181 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 14:54:35,340 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-30 14:54:35,540 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 14:54:35,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698677675181 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 14:54:35,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698677675181 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 14:54:35,542 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-30 14:54:35,679 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. completed. 2023-10-30 14:54:35,679 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:35,679 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-10-30 14:54:35,680 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-10-30 14:54:35,680 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,680 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1698677675181' locally completed 2023-10-30 14:54:35,680 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1698677675181' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:35,683 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698677675181/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,683 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1698677675181' has notified controller of completion 2023-10-30 14:54:35,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1698677675181/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:35,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-30 14:54:35,684 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:35,684 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1698677675181' completed. 2023-10-30 14:54:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:35,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:35,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698677675181 2023-10-30 14:54:35,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:35,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698677675181 2023-10-30 14:54:35,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1698677675181' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:35,693 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'snaptb-1698677675181', counting down latch. Waiting for 0 more 2023-10-30 14:54:35,693 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1698677675181' execution completed 2023-10-30 14:54:35,693 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:35,693 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:35,693 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1698677675181 2023-10-30 14:54:35,693 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1698677675181including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-30 14:54:35,699 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698677675181 2023-10-30 14:54:35,699 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698677675181 2023-10-30 14:54:35,699 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-30 14:54:35,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1698677675181 2023-10-30 14:54:35,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:35,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-30 14:54:35,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1698677675181 2023-10-30 14:54:35,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698677675181 2023-10-30 14:54:35,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:35,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-30 14:54:35,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-30 14:54:35,700 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1698677675181/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698677675181 2023-10-30 14:54:35,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698677675181 2023-10-30 14:54:35,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:35,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698677675181 2023-10-30 14:54:35,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,702 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1698677675181/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:35,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698677675181 2023-10-30 14:54:35,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,707 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-30 14:54:35,707 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-30 14:54:35,707 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698677675181/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-30 14:54:35,707 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:35,707 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1698677675181 2023-10-30 14:54:35,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-30 14:54:35,708 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-10-30 14:54:35,707 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698677675181 2023-10-30 14:54:35,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1698677675181 2023-10-30 14:54:35,708 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698677675181 2023-10-30 14:54:35,708 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698677675181/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:35,708 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698677675181 2023-10-30 14:54:35,708 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698677675181 2023-10-30 14:54:35,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-30 14:54:35,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-30 14:54:35,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-30 14:54:35,708 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698677675181 2023-10-30 14:54:35,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030306a95190aca471bb3fb90e9afe4c1b6, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310305b7e2588a2fd4fcf855be950885822ae, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310305d4c36e04d25494ebee0c2aca172e077, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030652fa08d7eaa489aa53112a25e4c6e52, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023103064f18b070bd6417b970ba5bf25812d1b, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030ad4c64c2896f4546ba4520b49f1c1bfe, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030d85f81458f234c52accfe89b5cc77d13, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030f6643351702042038f9dd4acd6531b12, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310301d84ee4c3d9b4d14a880aaa505aaffa5, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310306b07bd1b692b4ae08c74af088fe0fb4c, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023103081d39d6093c24c6089bddb6c87ad0027, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030d4476e19c8584a6ba1a6034376399e72] mob files 2023-10-30 14:54:35,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030306a95190aca471bb3fb90e9afe4c1b6 2023-10-30 14:54:35,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310305b7e2588a2fd4fcf855be950885822ae 2023-10-30 14:54:35,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310305d4c36e04d25494ebee0c2aca172e077 2023-10-30 14:54:35,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030652fa08d7eaa489aa53112a25e4c6e52 2023-10-30 14:54:35,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023103064f18b070bd6417b970ba5bf25812d1b 2023-10-30 14:54:35,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030ad4c64c2896f4546ba4520b49f1c1bfe 2023-10-30 14:54:35,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030d85f81458f234c52accfe89b5cc77d13 2023-10-30 14:54:35,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030f6643351702042038f9dd4acd6531b12 2023-10-30 14:54:35,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310301d84ee4c3d9b4d14a880aaa505aaffa5 2023-10-30 14:54:35,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310306b07bd1b692b4ae08c74af088fe0fb4c 2023-10-30 14:54:35,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023103081d39d6093c24c6089bddb6c87ad0027 2023-10-30 14:54:35,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030d4476e19c8584a6ba1a6034376399e72 2023-10-30 14:54:35,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103012f1a5e1fd2d4d70a013c31616b361e8, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103052fd2e67195e4f6f9006d3325678bf5c, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103094ab3781d55c4d569f11c57573387312, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030ea4d8161e3aa4ce68f1fca34a2462d2b, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310302d3e6fd4fecc43f89661bda688f12df4, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030791e633deb98414c93b811cadfb7a168, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030d938a4ee2e9f4c97aff9b4533d19701d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030f33973934ce04cf78eb06ec5d534f99f, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103046af05a6db584b00b23ab31e8a185b65, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310304d0a7814543843f59835dc40266c0b68, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103057b53ec6a60f4484a8d7572c7206f4e1, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030e8d2f245f5744ce3b46aa355a2b27cb2] mob files 2023-10-30 14:54:35,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103012f1a5e1fd2d4d70a013c31616b361e8 2023-10-30 14:54:35,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103052fd2e67195e4f6f9006d3325678bf5c 2023-10-30 14:54:35,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103094ab3781d55c4d569f11c57573387312 2023-10-30 14:54:35,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030ea4d8161e3aa4ce68f1fca34a2462d2b 2023-10-30 14:54:35,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310302d3e6fd4fecc43f89661bda688f12df4 2023-10-30 14:54:35,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030791e633deb98414c93b811cadfb7a168 2023-10-30 14:54:35,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030d938a4ee2e9f4c97aff9b4533d19701d 2023-10-30 14:54:35,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030f33973934ce04cf78eb06ec5d534f99f 2023-10-30 14:54:35,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103046af05a6db584b00b23ab31e8a185b65 2023-10-30 14:54:35,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310304d0a7814543843f59835dc40266c0b68 2023-10-30 14:54:35,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103057b53ec6a60f4484a8d7572c7206f4e1 2023-10-30 14:54:35,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030e8d2f245f5744ce3b46aa355a2b27cb2 2023-10-30 14:54:35,843 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 14:54:35,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698677675181 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 14:54:35,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698677675181 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 14:54:35,845 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-30 14:54:36,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1698677675181 2023-10-30 14:54:36,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.hbase-snapshot/.tmp/snaptb-1698677675181 2023-10-30 14:54:36,345 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 14:54:36,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698677675181 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 14:54:36,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698677675181 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 14:54:36,348 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-30 14:54:36,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.hbase-snapshot/.tmp/snaptb-1698677675181 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.hbase-snapshot/snaptb-1698677675181 2023-10-30 14:54:36,579 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1698677675181 of table testCompactionWithHFileLink completed 2023-10-30 14:54:36,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.hbase-snapshot/.tmp/snaptb-1698677675181 2023-10-30 14:54:36,580 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.hbase-snapshot/.tmp/snaptb-1698677675181 2023-10-30 14:54:36,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1698677675181 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698677675228Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1698677676121 (+893 ms)Consolidate snapshot: snaptb-1698677675181 at 1698677676121Loading Region manifests for snaptb-1698677675181 at 1698677676122 (+1 ms)Writing data manifest for snaptb-1698677675181 at 1698677676138 (+16 ms)Verifying snapshot: snaptb-1698677675181 at 1698677676551 (+413 ms)Snapshot snaptb-1698677675181 of table testCompactionWithHFileLink completed at 1698677676579 (+28 ms) 2023-10-30 14:54:36,581 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-30 14:54:36,582 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.3520 sec 2023-10-30 14:54:37,348 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 14:54:37,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698677675181 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 14:54:37,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1698677675181 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-30 14:54:37,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:37,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-30 14:54:37,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-30 14:54:37,400 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-30 14:54:37,401 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:37,401 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-30 14:54:37,401 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-30 14:54:37,401 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:37,401 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:37,402 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:37,402 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:37,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:37,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:37,403 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:37,403 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:37,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:37,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:37,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:37,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:37,404 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-30 14:54:37,404 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-30 14:54:37,404 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-30 14:54:37,404 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-30 14:54:37,404 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:37,404 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-30 14:54:37,405 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:37,405 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:37,405 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. started... 2023-10-30 14:54:37,405 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 14:54:37,405 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:37,405 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:37,405 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. started... 2023-10-30 14:54:37,405 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. started... 2023-10-30 14:54:37,405 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bb4420255160505884d9c82dfe0aed2b 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 14:54:37,405 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ae1fa8048a3a8e4b39683c8300846593 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 14:54:37,405 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 177e982e175e289e7a05a97bd09698ab 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 14:54:38,221 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family1/8dfa977abc894eda960c3bb591d6f8a3 2023-10-30 14:54:38,225 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family1/1a28b76451324a4c89bf0f44b151f4de 2023-10-30 14:54:38,227 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8dfa977abc894eda960c3bb591d6f8a3 2023-10-30 14:54:38,229 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family1/9a4293eba60e4862bb2efa94d1551433 2023-10-30 14:54:38,231 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a28b76451324a4c89bf0f44b151f4de 2023-10-30 14:54:38,237 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9a4293eba60e4862bb2efa94d1551433 2023-10-30 14:54:38,665 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family2/36e3147b9865421bbdff11d04324f341 2023-10-30 14:54:38,669 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 36e3147b9865421bbdff11d04324f341 2023-10-30 14:54:38,670 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family1/1a28b76451324a4c89bf0f44b151f4de as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/1a28b76451324a4c89bf0f44b151f4de 2023-10-30 14:54:38,673 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family2/8dd4739bf9ef45538e5a4f18c2d3658d 2023-10-30 14:54:38,674 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a28b76451324a4c89bf0f44b151f4de 2023-10-30 14:54:38,674 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/1a28b76451324a4c89bf0f44b151f4de, entries=3, sequenceid=24, filesize=5.0 K 2023-10-30 14:54:38,674 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family2/36e3147b9865421bbdff11d04324f341 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/36e3147b9865421bbdff11d04324f341 2023-10-30 14:54:38,679 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8dd4739bf9ef45538e5a4f18c2d3658d 2023-10-30 14:54:38,680 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family1/9a4293eba60e4862bb2efa94d1551433 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/9a4293eba60e4862bb2efa94d1551433 2023-10-30 14:54:38,685 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 36e3147b9865421bbdff11d04324f341 2023-10-30 14:54:38,685 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/36e3147b9865421bbdff11d04324f341, entries=1, sequenceid=24, filesize=5.0 K 2023-10-30 14:54:38,686 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ae1fa8048a3a8e4b39683c8300846593 in 1281ms, sequenceid=24, compaction requested=true 2023-10-30 14:54:38,686 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ae1fa8048a3a8e4b39683c8300846593: 2023-10-30 14:54:38,686 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:38,686 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 14:54:38,690 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9a4293eba60e4862bb2efa94d1551433 2023-10-30 14:54:38,690 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/9a4293eba60e4862bb2efa94d1551433, entries=3, sequenceid=24, filesize=5.0 K 2023-10-30 14:54:38,691 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family2/8dd4739bf9ef45538e5a4f18c2d3658d as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/8dd4739bf9ef45538e5a4f18c2d3658d 2023-10-30 14:54:38,703 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8dd4739bf9ef45538e5a4f18c2d3658d 2023-10-30 14:54:38,703 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/8dd4739bf9ef45538e5a4f18c2d3658d, entries=1, sequenceid=24, filesize=5.0 K 2023-10-30 14:54:38,704 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for bb4420255160505884d9c82dfe0aed2b in 1299ms, sequenceid=24, compaction requested=true 2023-10-30 14:54:38,704 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bb4420255160505884d9c82dfe0aed2b: 2023-10-30 14:54:38,704 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:38,704 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 14:54:39,047 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family2/94f871d7764e4024822ef6d169659776 2023-10-30 14:54:39,055 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 94f871d7764e4024822ef6d169659776 2023-10-30 14:54:39,056 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family1/8dfa977abc894eda960c3bb591d6f8a3 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/8dfa977abc894eda960c3bb591d6f8a3 2023-10-30 14:54:39,061 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8dfa977abc894eda960c3bb591d6f8a3 2023-10-30 14:54:39,062 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/8dfa977abc894eda960c3bb591d6f8a3, entries=3, sequenceid=24, filesize=5.0 K 2023-10-30 14:54:39,063 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family2/94f871d7764e4024822ef6d169659776 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/94f871d7764e4024822ef6d169659776 2023-10-30 14:54:39,068 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 94f871d7764e4024822ef6d169659776 2023-10-30 14:54:39,068 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/94f871d7764e4024822ef6d169659776, entries=1, sequenceid=24, filesize=5.0 K 2023-10-30 14:54:39,069 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 177e982e175e289e7a05a97bd09698ab in 1664ms, sequenceid=24, compaction requested=true 2023-10-30 14:54:39,069 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 177e982e175e289e7a05a97bd09698ab: 2023-10-30 14:54:39,069 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:39,069 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 14:54:39,069 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 14:54:39,069 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:39,069 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-30 14:54:39,069 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-30 14:54:39,072 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:39,073 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:39,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:39,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-30 14:54:39,074 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-30 14:54:39,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15190b0[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:39,074 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:39,075 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:39,075 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:39,076 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:39,076 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:39,077 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:39,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:39,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:39,078 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-30 14:54:39,078 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-30 14:54:39,078 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:39,079 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-30 14:54:39,079 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:39,079 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-30 14:54:39,080 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:39,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:39,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:39,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:39,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:39,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:39,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:39,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:39,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:39,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-30 14:54:39,087 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-30 14:54:39,087 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:39,087 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:39,087 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-30 14:54:39,087 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:39,099 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:39,099 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:39,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:39,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:39,099 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:39,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:39,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:39,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:39,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:39,101 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:39,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:39,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:39,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:39,103 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 14:54:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:39,107 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:39,107 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:39,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:39,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-30 14:54:39,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:39,107 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:39,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:39,107 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:39,107 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:39,107 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 14:54:39,107 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:39,107 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:39,108 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:39,108 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:39,108 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 14:54:39,108 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 14:54:39,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:39,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:39,208 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:39,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:39,210 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:54:39,210 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): 177e982e175e289e7a05a97bd09698ab/family1 is initiating major compaction (all files) 2023-10-30 14:54:39,210 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:54:39,210 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:54:39,211 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of 177e982e175e289e7a05a97bd09698ab/family1 in testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:39,211 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/2b47a1baeecd4aa1ad0a3c96868a7d18, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/aa621a482a484c03adc30abe5de75ad6, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/ab92fff50dab4ae2982dd62a74c7a087, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/ad30394daddd43ab8c1062194de0e1e9, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/8dfa977abc894eda960c3bb591d6f8a3] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp, totalSize=26.7 K 2023-10-30 14:54:39,211 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 2b47a1baeecd4aa1ad0a3c96868a7d18, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677668183 2023-10-30 14:54:39,212 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting aa621a482a484c03adc30abe5de75ad6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677670013 2023-10-30 14:54:39,212 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting ab92fff50dab4ae2982dd62a74c7a087, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677671839 2023-10-30 14:54:39,213 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting ad30394daddd43ab8c1062194de0e1e9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677673772 2023-10-30 14:54:39,213 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 8dfa977abc894eda960c3bb591d6f8a3, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 14:54:39,236 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): 177e982e175e289e7a05a97bd09698ab#family1#compaction#108 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:54:39,646 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231030e8fb001e287b456c802aa6a46d82b515_del 2023-10-30 14:54:39,646 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030e8fb001e287b456c802aa6a46d82b515_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030e8fb001e287b456c802aa6a46d82b515_del 2023-10-30 14:54:40,472 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c1940cd487e14ce09c99888dad24d38d 2023-10-30 14:54:40,474 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family1/c1940cd487e14ce09c99888dad24d38d as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/c1940cd487e14ce09c99888dad24d38d 2023-10-30 14:54:40,480 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c1940cd487e14ce09c99888dad24d38d 2023-10-30 14:54:40,481 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 177e982e175e289e7a05a97bd09698ab/family1 of 177e982e175e289e7a05a97bd09698ab into c1940cd487e14ce09c99888dad24d38d(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:54:40,482 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for 177e982e175e289e7a05a97bd09698ab: 2023-10-30 14:54:40,482 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:54:40,482 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): 177e982e175e289e7a05a97bd09698ab/family2 is initiating major compaction (all files) 2023-10-30 14:54:40,482 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:54:40,482 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:54:40,482 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of 177e982e175e289e7a05a97bd09698ab/family2 in testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:40,482 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/53bcf2454ffe4417923cc96b7a80572d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/54b63ff7f107495b9b03d1485db0e3c4, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/842819db31bd40db9555b648b51e83e3, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/49944bc1a53c4289b0eb4d14a1ba38a7, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/94f871d7764e4024822ef6d169659776] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp, totalSize=25.4 K 2023-10-30 14:54:40,483 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 53bcf2454ffe4417923cc96b7a80572d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677668183 2023-10-30 14:54:40,483 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 54b63ff7f107495b9b03d1485db0e3c4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677670013 2023-10-30 14:54:40,484 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 842819db31bd40db9555b648b51e83e3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677671839 2023-10-30 14:54:40,484 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 49944bc1a53c4289b0eb4d14a1ba38a7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677673772 2023-10-30 14:54:40,484 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 94f871d7764e4024822ef6d169659776, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 14:54:40,496 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): 177e982e175e289e7a05a97bd09698ab#family2#compaction#109 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:54:40,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/2b47a1baeecd4aa1ad0a3c96868a7d18, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/aa621a482a484c03adc30abe5de75ad6, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/ab92fff50dab4ae2982dd62a74c7a087, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/ad30394daddd43ab8c1062194de0e1e9, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/8dfa977abc894eda960c3bb591d6f8a3] to archive 2023-10-30 14:54:40,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:40,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/2b47a1baeecd4aa1ad0a3c96868a7d18 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/2b47a1baeecd4aa1ad0a3c96868a7d18 2023-10-30 14:54:40,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/aa621a482a484c03adc30abe5de75ad6 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/aa621a482a484c03adc30abe5de75ad6 2023-10-30 14:54:40,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/ab92fff50dab4ae2982dd62a74c7a087 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/ab92fff50dab4ae2982dd62a74c7a087 2023-10-30 14:54:40,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/ad30394daddd43ab8c1062194de0e1e9 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/ad30394daddd43ab8c1062194de0e1e9 2023-10-30 14:54:40,512 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/8dfa977abc894eda960c3bb591d6f8a3 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/8dfa977abc894eda960c3bb591d6f8a3 2023-10-30 14:54:40,911 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310306ef6ebc6de7c4d5ca232e7cd0e3df1e7_del 2023-10-30 14:54:40,912 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310306ef6ebc6de7c4d5ca232e7cd0e3df1e7_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310306ef6ebc6de7c4d5ca232e7cd0e3df1e7_del 2023-10-30 14:54:41,742 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cadc094e9bef43d882e4b9be65f5286d 2023-10-30 14:54:41,742 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family2/cadc094e9bef43d882e4b9be65f5286d as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/cadc094e9bef43d882e4b9be65f5286d 2023-10-30 14:54:41,747 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cadc094e9bef43d882e4b9be65f5286d 2023-10-30 14:54:41,748 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 177e982e175e289e7a05a97bd09698ab/family2 of 177e982e175e289e7a05a97bd09698ab into cadc094e9bef43d882e4b9be65f5286d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:54:41,748 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for 177e982e175e289e7a05a97bd09698ab: 2023-10-30 14:54:41,748 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:54:41,748 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): ae1fa8048a3a8e4b39683c8300846593/family1 is initiating major compaction (all files) 2023-10-30 14:54:41,749 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:54:41,749 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:54:41,749 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of ae1fa8048a3a8e4b39683c8300846593/family1 in testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:41,749 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/295e1e182a8645f2b8e4c0bbbd048585, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/b598326d3877443f8a5c2ce183ba1ced, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/4808a5156fa94e7fae3d06858c38b36e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/de1b296614cb4a1fbc6d3967bac55140, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/1a28b76451324a4c89bf0f44b151f4de] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp, totalSize=26.7 K 2023-10-30 14:54:41,750 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 295e1e182a8645f2b8e4c0bbbd048585, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677668182 2023-10-30 14:54:41,750 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting b598326d3877443f8a5c2ce183ba1ced, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677670012 2023-10-30 14:54:41,751 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 4808a5156fa94e7fae3d06858c38b36e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677671838 2023-10-30 14:54:41,751 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting de1b296614cb4a1fbc6d3967bac55140, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677673771 2023-10-30 14:54:41,752 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 1a28b76451324a4c89bf0f44b151f4de, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 14:54:41,766 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): ae1fa8048a3a8e4b39683c8300846593#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:54:41,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/53bcf2454ffe4417923cc96b7a80572d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/54b63ff7f107495b9b03d1485db0e3c4, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/842819db31bd40db9555b648b51e83e3, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/49944bc1a53c4289b0eb4d14a1ba38a7, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/94f871d7764e4024822ef6d169659776] to archive 2023-10-30 14:54:41,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:41,812 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/53bcf2454ffe4417923cc96b7a80572d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/53bcf2454ffe4417923cc96b7a80572d 2023-10-30 14:54:41,813 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/54b63ff7f107495b9b03d1485db0e3c4 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/54b63ff7f107495b9b03d1485db0e3c4 2023-10-30 14:54:41,814 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/842819db31bd40db9555b648b51e83e3 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/842819db31bd40db9555b648b51e83e3 2023-10-30 14:54:41,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/49944bc1a53c4289b0eb4d14a1ba38a7 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/49944bc1a53c4289b0eb4d14a1ba38a7 2023-10-30 14:54:41,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/94f871d7764e4024822ef6d169659776 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/94f871d7764e4024822ef6d169659776 2023-10-30 14:54:42,186 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231030e4aea2f69e5e4e039dbdbc752dcc1134_del 2023-10-30 14:54:42,186 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030e4aea2f69e5e4e039dbdbc752dcc1134_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030e4aea2f69e5e4e039dbdbc752dcc1134_del 2023-10-30 14:54:43,018 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 687f02926d3445d8abbc37faa93f4572 2023-10-30 14:54:43,019 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family1/687f02926d3445d8abbc37faa93f4572 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/687f02926d3445d8abbc37faa93f4572 2023-10-30 14:54:43,024 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 687f02926d3445d8abbc37faa93f4572 2023-10-30 14:54:43,025 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ae1fa8048a3a8e4b39683c8300846593/family1 of ae1fa8048a3a8e4b39683c8300846593 into 687f02926d3445d8abbc37faa93f4572(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:54:43,025 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for ae1fa8048a3a8e4b39683c8300846593: 2023-10-30 14:54:43,025 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:54:43,025 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): ae1fa8048a3a8e4b39683c8300846593/family2 is initiating major compaction (all files) 2023-10-30 14:54:43,025 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:54:43,025 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:54:43,025 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of ae1fa8048a3a8e4b39683c8300846593/family2 in testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:43,026 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/a894379bbf574430a9752a8e8fe13ea4, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/32bfccbe5e7f4ffa98cc1d1b8f0aa0d5, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/2585357f0708418eb01e1e185092d495, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/a37fba37977a400b9a368a162f1a8993, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/36e3147b9865421bbdff11d04324f341] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp, totalSize=25.4 K 2023-10-30 14:54:43,026 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting a894379bbf574430a9752a8e8fe13ea4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677668182 2023-10-30 14:54:43,027 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 32bfccbe5e7f4ffa98cc1d1b8f0aa0d5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677670012 2023-10-30 14:54:43,027 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 2585357f0708418eb01e1e185092d495, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677671838 2023-10-30 14:54:43,027 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting a37fba37977a400b9a368a162f1a8993, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677673771 2023-10-30 14:54:43,028 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 36e3147b9865421bbdff11d04324f341, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 14:54:43,041 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): ae1fa8048a3a8e4b39683c8300846593#family2#compaction#111 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:54:43,108 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/295e1e182a8645f2b8e4c0bbbd048585, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/b598326d3877443f8a5c2ce183ba1ced, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/4808a5156fa94e7fae3d06858c38b36e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/de1b296614cb4a1fbc6d3967bac55140, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/1a28b76451324a4c89bf0f44b151f4de] to archive 2023-10-30 14:54:43,108 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:43,110 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/295e1e182a8645f2b8e4c0bbbd048585 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/295e1e182a8645f2b8e4c0bbbd048585 2023-10-30 14:54:43,111 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/b598326d3877443f8a5c2ce183ba1ced to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/b598326d3877443f8a5c2ce183ba1ced 2023-10-30 14:54:43,112 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/4808a5156fa94e7fae3d06858c38b36e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/4808a5156fa94e7fae3d06858c38b36e 2023-10-30 14:54:43,113 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/de1b296614cb4a1fbc6d3967bac55140 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/de1b296614cb4a1fbc6d3967bac55140 2023-10-30 14:54:43,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/1a28b76451324a4c89bf0f44b151f4de to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/1a28b76451324a4c89bf0f44b151f4de 2023-10-30 14:54:43,458 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231030ca9ac6bbcd04437eb3fc932fa427010b_del 2023-10-30 14:54:43,458 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030ca9ac6bbcd04437eb3fc932fa427010b_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030ca9ac6bbcd04437eb3fc932fa427010b_del 2023-10-30 14:54:44,294 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ba4a8f3149438197ed73940bdbf674 2023-10-30 14:54:44,295 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family2/c4ba4a8f3149438197ed73940bdbf674 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/c4ba4a8f3149438197ed73940bdbf674 2023-10-30 14:54:44,300 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ba4a8f3149438197ed73940bdbf674 2023-10-30 14:54:44,301 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ae1fa8048a3a8e4b39683c8300846593/family2 of ae1fa8048a3a8e4b39683c8300846593 into c4ba4a8f3149438197ed73940bdbf674(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:54:44,301 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for ae1fa8048a3a8e4b39683c8300846593: 2023-10-30 14:54:44,301 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:54:44,301 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): bb4420255160505884d9c82dfe0aed2b/family1 is initiating major compaction (all files) 2023-10-30 14:54:44,301 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:54:44,301 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:54:44,302 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of bb4420255160505884d9c82dfe0aed2b/family1 in testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:44,302 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/759e3982aa854502a1ce7acd8e912e27, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/ea958de57c9f4ab68aced0e68b1dc78e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/f74278cae04e42c2964dcd29438480ca, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/cb4f7beb9e6145b69a78a38546bb4fc5, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/9a4293eba60e4862bb2efa94d1551433] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp, totalSize=26.7 K 2023-10-30 14:54:44,302 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 759e3982aa854502a1ce7acd8e912e27, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677668183 2023-10-30 14:54:44,303 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting ea958de57c9f4ab68aced0e68b1dc78e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677670013 2023-10-30 14:54:44,303 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting f74278cae04e42c2964dcd29438480ca, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677671839 2023-10-30 14:54:44,304 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting cb4f7beb9e6145b69a78a38546bb4fc5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677673772 2023-10-30 14:54:44,304 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 9a4293eba60e4862bb2efa94d1551433, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 14:54:44,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/a894379bbf574430a9752a8e8fe13ea4, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/32bfccbe5e7f4ffa98cc1d1b8f0aa0d5, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/2585357f0708418eb01e1e185092d495, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/a37fba37977a400b9a368a162f1a8993, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/36e3147b9865421bbdff11d04324f341] to archive 2023-10-30 14:54:44,313 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:44,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/a894379bbf574430a9752a8e8fe13ea4 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/a894379bbf574430a9752a8e8fe13ea4 2023-10-30 14:54:44,316 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/32bfccbe5e7f4ffa98cc1d1b8f0aa0d5 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/32bfccbe5e7f4ffa98cc1d1b8f0aa0d5 2023-10-30 14:54:44,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/2585357f0708418eb01e1e185092d495 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/2585357f0708418eb01e1e185092d495 2023-10-30 14:54:44,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/a37fba37977a400b9a368a162f1a8993 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/a37fba37977a400b9a368a162f1a8993 2023-10-30 14:54:44,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/36e3147b9865421bbdff11d04324f341 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/36e3147b9865421bbdff11d04324f341 2023-10-30 14:54:44,320 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): bb4420255160505884d9c82dfe0aed2b#family1#compaction#112 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:54:44,737 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231030371c0adb199445a1a0def78a26aca114_del 2023-10-30 14:54:44,737 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030371c0adb199445a1a0def78a26aca114_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030371c0adb199445a1a0def78a26aca114_del 2023-10-30 14:54:45,568 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c263ecd8672494fb8067d5029d24e77 2023-10-30 14:54:45,569 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family1/9c263ecd8672494fb8067d5029d24e77 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/9c263ecd8672494fb8067d5029d24e77 2023-10-30 14:54:45,574 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c263ecd8672494fb8067d5029d24e77 2023-10-30 14:54:45,575 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bb4420255160505884d9c82dfe0aed2b/family1 of bb4420255160505884d9c82dfe0aed2b into 9c263ecd8672494fb8067d5029d24e77(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:54:45,575 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for bb4420255160505884d9c82dfe0aed2b: 2023-10-30 14:54:45,575 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:54:45,575 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): bb4420255160505884d9c82dfe0aed2b/family2 is initiating major compaction (all files) 2023-10-30 14:54:45,575 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:54:45,575 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:54:45,576 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of bb4420255160505884d9c82dfe0aed2b/family2 in testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:45,576 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/581a155e7d464babbdeafdaab27919b1, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/401ae32ee6274f79bd17dc7a11d6b617, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/deff8397ffde4b2480faeb0b70f4f9c3, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/a71b6279cb934faf9d40886373be5d6d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/8dd4739bf9ef45538e5a4f18c2d3658d] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp, totalSize=25.4 K 2023-10-30 14:54:45,576 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 581a155e7d464babbdeafdaab27919b1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677668183 2023-10-30 14:54:45,577 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 401ae32ee6274f79bd17dc7a11d6b617, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677670013 2023-10-30 14:54:45,577 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting deff8397ffde4b2480faeb0b70f4f9c3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677671839 2023-10-30 14:54:45,578 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting a71b6279cb934faf9d40886373be5d6d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677673772 2023-10-30 14:54:45,578 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 8dd4739bf9ef45538e5a4f18c2d3658d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 14:54:45,588 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): bb4420255160505884d9c82dfe0aed2b#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:54:45,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/759e3982aa854502a1ce7acd8e912e27, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/ea958de57c9f4ab68aced0e68b1dc78e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/f74278cae04e42c2964dcd29438480ca, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/cb4f7beb9e6145b69a78a38546bb4fc5, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/9a4293eba60e4862bb2efa94d1551433] to archive 2023-10-30 14:54:45,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:45,603 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/759e3982aa854502a1ce7acd8e912e27 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/759e3982aa854502a1ce7acd8e912e27 2023-10-30 14:54:45,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/ea958de57c9f4ab68aced0e68b1dc78e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/ea958de57c9f4ab68aced0e68b1dc78e 2023-10-30 14:54:45,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/f74278cae04e42c2964dcd29438480ca to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/f74278cae04e42c2964dcd29438480ca 2023-10-30 14:54:45,606 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/cb4f7beb9e6145b69a78a38546bb4fc5 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/cb4f7beb9e6145b69a78a38546bb4fc5 2023-10-30 14:54:45,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/9a4293eba60e4862bb2efa94d1551433 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/9a4293eba60e4862bb2efa94d1551433 2023-10-30 14:54:46,000 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202310306772845d1c4c4d1aaca156189645a9e1_del 2023-10-30 14:54:46,001 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310306772845d1c4c4d1aaca156189645a9e1_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310306772845d1c4c4d1aaca156189645a9e1_del 2023-10-30 14:54:46,831 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0372d4f966d1436ba34e74d12e9f83e7 2023-10-30 14:54:46,831 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family2/0372d4f966d1436ba34e74d12e9f83e7 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/0372d4f966d1436ba34e74d12e9f83e7 2023-10-30 14:54:46,836 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0372d4f966d1436ba34e74d12e9f83e7 2023-10-30 14:54:46,837 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bb4420255160505884d9c82dfe0aed2b/family2 of bb4420255160505884d9c82dfe0aed2b into 0372d4f966d1436ba34e74d12e9f83e7(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:54:46,838 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for bb4420255160505884d9c82dfe0aed2b: 2023-10-30 14:54:46,844 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:54:46,849 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:54:46,856 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:54:46,857 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:54:46,863 INFO [Listener at localhost/34621] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 14:54:46,895 INFO [Listener at localhost/34621] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-10-30 14:54:46,899 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231030e4aea2f69e5e4e039dbdbc752dcc1134_del 2023-10-30 14:54:46,900 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/581a155e7d464babbdeafdaab27919b1, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/401ae32ee6274f79bd17dc7a11d6b617, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/deff8397ffde4b2480faeb0b70f4f9c3, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/a71b6279cb934faf9d40886373be5d6d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/8dd4739bf9ef45538e5a4f18c2d3658d] to archive 2023-10-30 14:54:46,901 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:46,902 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/581a155e7d464babbdeafdaab27919b1 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/581a155e7d464babbdeafdaab27919b1 2023-10-30 14:54:46,903 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231030371c0adb199445a1a0def78a26aca114_del 2023-10-30 14:54:46,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/401ae32ee6274f79bd17dc7a11d6b617 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/401ae32ee6274f79bd17dc7a11d6b617 2023-10-30 14:54:46,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/deff8397ffde4b2480faeb0b70f4f9c3 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/deff8397ffde4b2480faeb0b70f4f9c3 2023-10-30 14:54:46,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/a71b6279cb934faf9d40886373be5d6d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/a71b6279cb934faf9d40886373be5d6d 2023-10-30 14:54:46,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/8dd4739bf9ef45538e5a4f18c2d3658d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/8dd4739bf9ef45538e5a4f18c2d3658d 2023-10-30 14:54:46,909 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231030e8fb001e287b456c802aa6a46d82b515_del 2023-10-30 14:54:46,910 INFO [Listener at localhost/34621] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-10-30 14:54:46,911 DEBUG [Listener at localhost/34621] zookeeper.ReadOnlyZKClient(139): Connect 0x7bc887e3 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:54:46,916 DEBUG [Listener at localhost/34621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a262ebf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:54:46,916 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 14:54:46,916 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 14:54:46,916 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 14:54:47,393 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103014267d9715f942708139b667831e1c54 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023103014267d9715f942708139b667831e1c54 2023-10-30 14:54:47,394 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 14:54:47,408 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:54:47,411 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44928, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:54:47,419 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 14:54:47,421 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 14:54:47,430 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/a06f4790423049069feeb5767026d1c7 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-10-30 14:54:47,430 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/a06f4790423049069feeb5767026d1c7}] 2023-10-30 14:54:47,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/a06f4790423049069feeb5767026d1c7 for inclusion in bb4420255160505884d9c82dfe0aed2b/family1 2023-10-30 14:54:47,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-10-30 14:54:47,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-30 14:54:47,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for bb4420255160505884d9c82dfe0aed2b: 2023-10-30 14:54:47,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/a06f4790423049069feeb5767026d1c7 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__41rok68vsv59p1u5na5h2lfu743kftm890h0nf0c5jgvrjt7ao8v92tthrkcouva/family1/a06f4790423049069feeb5767026d1c7 2023-10-30 14:54:47,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__41rok68vsv59p1u5na5h2lfu743kftm890h0nf0c5jgvrjt7ao8v92tthrkcouva/family1/a06f4790423049069feeb5767026d1c7 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/7c58195607a94edea82c578a1da8508e_SeqId_29_ 2023-10-30 14:54:47,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__41rok68vsv59p1u5na5h2lfu743kftm890h0nf0c5jgvrjt7ao8v92tthrkcouva/family1/a06f4790423049069feeb5767026d1c7 into bb4420255160505884d9c82dfe0aed2b/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/7c58195607a94edea82c578a1da8508e_SeqId_29_ - updating store file list. 2023-10-30 14:54:47,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/7c58195607a94edea82c578a1da8508e_SeqId_29_ into bb4420255160505884d9c82dfe0aed2b/family1 2023-10-30 14:54:47,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__41rok68vsv59p1u5na5h2lfu743kftm890h0nf0c5jgvrjt7ao8v92tthrkcouva/family1/a06f4790423049069feeb5767026d1c7 into bb4420255160505884d9c82dfe0aed2b/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/7c58195607a94edea82c578a1da8508e_SeqId_29_) 2023-10-30 14:54:47,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__41rok68vsv59p1u5na5h2lfu743kftm890h0nf0c5jgvrjt7ao8v92tthrkcouva/family1/a06f4790423049069feeb5767026d1c7 2023-10-30 14:54:47,453 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 14:54:47,454 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:47,456 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030306a95190aca471bb3fb90e9afe4c1b6 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030306a95190aca471bb3fb90e9afe4c1b6 2023-10-30 14:54:47,458 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310305b7e2588a2fd4fcf855be950885822ae to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310305b7e2588a2fd4fcf855be950885822ae 2023-10-30 14:54:47,460 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310305d4c36e04d25494ebee0c2aca172e077 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310305d4c36e04d25494ebee0c2aca172e077 2023-10-30 14:54:47,462 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030652fa08d7eaa489aa53112a25e4c6e52 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030652fa08d7eaa489aa53112a25e4c6e52 2023-10-30 14:54:47,462 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 14:54:47,462 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030' 2023-10-30 14:54:47,463 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 14:54:47,805 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030cf27bffba56d45bdbfc36ff48f6d1402 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030cf27bffba56d45bdbfc36ff48f6d1402 2023-10-30 14:54:47,805 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310309b66b0c95aaf4a478da650eaee528f65 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310309b66b0c95aaf4a478da650eaee528f65 2023-10-30 14:54:47,806 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 14:54:47,806 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 14:54:47,829 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/31be3bacda1c48e98eadba33068faaf2 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-10-30 14:54:47,829 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/66f3f32a502e4db581410af4eab074a1 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-10-30 14:54:47,832 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/31be3bacda1c48e98eadba33068faaf2}] 2023-10-30 14:54:47,832 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/66f3f32a502e4db581410af4eab074a1}] 2023-10-30 14:54:47,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/66f3f32a502e4db581410af4eab074a1 for inclusion in 177e982e175e289e7a05a97bd09698ab/family1 2023-10-30 14:54:47,835 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/31be3bacda1c48e98eadba33068faaf2 for inclusion in ae1fa8048a3a8e4b39683c8300846593/family1 2023-10-30 14:54:47,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-10-30 14:54:47,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-10-30 14:54:47,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-30 14:54:47,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last=1 2023-10-30 14:54:47,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 177e982e175e289e7a05a97bd09698ab: 2023-10-30 14:54:47,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for ae1fa8048a3a8e4b39683c8300846593: 2023-10-30 14:54:47,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/66f3f32a502e4db581410af4eab074a1 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__u72c0a6ojubsmdila7gjgv388gg2u2n5c0io6683qdlanfmm9rrl2cemg3uprb8l/family1/66f3f32a502e4db581410af4eab074a1 2023-10-30 14:54:47,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/31be3bacda1c48e98eadba33068faaf2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__sag683lqsd2neqe56nheru3tfv33bfij6onj7vra9rc02qfjcu40g7knjrb8e3io/family1/31be3bacda1c48e98eadba33068faaf2 2023-10-30 14:54:47,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__u72c0a6ojubsmdila7gjgv388gg2u2n5c0io6683qdlanfmm9rrl2cemg3uprb8l/family1/66f3f32a502e4db581410af4eab074a1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/83bc99b049504a00942b42a2e23a8b02_SeqId_29_ 2023-10-30 14:54:47,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__sag683lqsd2neqe56nheru3tfv33bfij6onj7vra9rc02qfjcu40g7knjrb8e3io/family1/31be3bacda1c48e98eadba33068faaf2 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/c220192ac67f49b4999b2c8b66a89b27_SeqId_29_ 2023-10-30 14:54:47,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__u72c0a6ojubsmdila7gjgv388gg2u2n5c0io6683qdlanfmm9rrl2cemg3uprb8l/family1/66f3f32a502e4db581410af4eab074a1 into 177e982e175e289e7a05a97bd09698ab/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/83bc99b049504a00942b42a2e23a8b02_SeqId_29_ - updating store file list. 2023-10-30 14:54:47,844 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__sag683lqsd2neqe56nheru3tfv33bfij6onj7vra9rc02qfjcu40g7knjrb8e3io/family1/31be3bacda1c48e98eadba33068faaf2 into ae1fa8048a3a8e4b39683c8300846593/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/c220192ac67f49b4999b2c8b66a89b27_SeqId_29_ - updating store file list. 2023-10-30 14:54:47,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/83bc99b049504a00942b42a2e23a8b02_SeqId_29_ into 177e982e175e289e7a05a97bd09698ab/family1 2023-10-30 14:54:47,847 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/c220192ac67f49b4999b2c8b66a89b27_SeqId_29_ into ae1fa8048a3a8e4b39683c8300846593/family1 2023-10-30 14:54:47,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__u72c0a6ojubsmdila7gjgv388gg2u2n5c0io6683qdlanfmm9rrl2cemg3uprb8l/family1/66f3f32a502e4db581410af4eab074a1 into 177e982e175e289e7a05a97bd09698ab/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/83bc99b049504a00942b42a2e23a8b02_SeqId_29_) 2023-10-30 14:54:47,847 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__sag683lqsd2neqe56nheru3tfv33bfij6onj7vra9rc02qfjcu40g7knjrb8e3io/family1/31be3bacda1c48e98eadba33068faaf2 into ae1fa8048a3a8e4b39683c8300846593/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/c220192ac67f49b4999b2c8b66a89b27_SeqId_29_) 2023-10-30 14:54:47,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__u72c0a6ojubsmdila7gjgv388gg2u2n5c0io6683qdlanfmm9rrl2cemg3uprb8l/family1/66f3f32a502e4db581410af4eab074a1 2023-10-30 14:54:47,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__sag683lqsd2neqe56nheru3tfv33bfij6onj7vra9rc02qfjcu40g7knjrb8e3io/family1/31be3bacda1c48e98eadba33068faaf2 2023-10-30 14:54:47,849 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 14:54:47,850 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 14:54:47,850 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:47,850 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:47,851 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310301d84ee4c3d9b4d14a880aaa505aaffa5 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310301d84ee4c3d9b4d14a880aaa505aaffa5 2023-10-30 14:54:47,851 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023103064f18b070bd6417b970ba5bf25812d1b to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023103064f18b070bd6417b970ba5bf25812d1b 2023-10-30 14:54:47,852 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310306b07bd1b692b4ae08c74af088fe0fb4c to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310306b07bd1b692b4ae08c74af088fe0fb4c 2023-10-30 14:54:47,852 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030ad4c64c2896f4546ba4520b49f1c1bfe to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030ad4c64c2896f4546ba4520b49f1c1bfe 2023-10-30 14:54:47,853 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023103081d39d6093c24c6089bddb6c87ad0027 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023103081d39d6093c24c6089bddb6c87ad0027 2023-10-30 14:54:47,853 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030d85f81458f234c52accfe89b5cc77d13 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030d85f81458f234c52accfe89b5cc77d13 2023-10-30 14:54:47,854 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030d4476e19c8584a6ba1a6034376399e72 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030d4476e19c8584a6ba1a6034376399e72 2023-10-30 14:54:47,854 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 14:54:47,854 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030f6643351702042038f9dd4acd6531b12 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030f6643351702042038f9dd4acd6531b12 2023-10-30 14:54:47,854 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030' 2023-10-30 14:54:47,854 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 14:54:47,854 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030' 2023-10-30 14:54:47,854 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 14:54:47,855 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 14:54:47,855 INFO [Listener at localhost/34621] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-10-30 14:54:47,855 INFO [Listener at localhost/34621] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 14:54:47,855 INFO [Listener at localhost/34621] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030e4aea2f69e5e4e039dbdbc752dcc1134_del] 2023-10-30 14:54:47,855 DEBUG [Listener at localhost/34621] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:47,856 DEBUG [Listener at localhost/34621] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030e4aea2f69e5e4e039dbdbc752dcc1134_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030e4aea2f69e5e4e039dbdbc752dcc1134_del 2023-10-30 14:54:47,857 INFO [Listener at localhost/34621] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-30 14:54:47,857 INFO [Listener at localhost/34621] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030371c0adb199445a1a0def78a26aca114_del] 2023-10-30 14:54:47,857 DEBUG [Listener at localhost/34621] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:47,858 DEBUG [Listener at localhost/34621] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030371c0adb199445a1a0def78a26aca114_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030371c0adb199445a1a0def78a26aca114_del 2023-10-30 14:54:47,858 INFO [Listener at localhost/34621] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-30 14:54:47,858 INFO [Listener at localhost/34621] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030e8fb001e287b456c802aa6a46d82b515_del] 2023-10-30 14:54:47,859 DEBUG [Listener at localhost/34621] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:47,860 DEBUG [Listener at localhost/34621] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030e8fb001e287b456c802aa6a46d82b515_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030e8fb001e287b456c802aa6a46d82b515_del 2023-10-30 14:54:47,860 INFO [Listener at localhost/34621] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-30 14:54:47,862 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:54:47,866 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:54:47,870 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:54:47,871 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:54:47,877 INFO [Listener at localhost/34621] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-10-30 14:54:47,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testCompactionWithHFileLink 2023-10-30 14:54:47,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-10-30 14:54:47,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-30 14:54:47,881 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677687880"}]},"ts":"1698677687880"} 2023-10-30 14:54:47,882 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-10-30 14:54:47,883 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-10-30 14:54:47,883 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ae1fa8048a3a8e4b39683c8300846593, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb4420255160505884d9c82dfe0aed2b, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=177e982e175e289e7a05a97bd09698ab, UNASSIGN}] 2023-10-30 14:54:47,885 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb4420255160505884d9c82dfe0aed2b, UNASSIGN 2023-10-30 14:54:47,885 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=177e982e175e289e7a05a97bd09698ab, UNASSIGN 2023-10-30 14:54:47,885 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ae1fa8048a3a8e4b39683c8300846593, UNASSIGN 2023-10-30 14:54:47,885 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=bb4420255160505884d9c82dfe0aed2b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:47,885 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=ae1fa8048a3a8e4b39683c8300846593, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:47,885 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=177e982e175e289e7a05a97bd09698ab, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:47,885 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698677687885"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677687885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677687885"}]},"ts":"1698677687885"} 2023-10-30 14:54:47,886 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698677687885"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677687885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677687885"}]},"ts":"1698677687885"} 2023-10-30 14:54:47,885 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698677687885"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677687885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677687885"}]},"ts":"1698677687885"} 2023-10-30 14:54:47,886 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure bb4420255160505884d9c82dfe0aed2b, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:47,887 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure 177e982e175e289e7a05a97bd09698ab, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:47,887 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure ae1fa8048a3a8e4b39683c8300846593, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:47,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-30 14:54:48,038 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:48,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:48,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing bb4420255160505884d9c82dfe0aed2b, disabling compactions & flushes 2023-10-30 14:54:48,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:48,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:48,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. after waiting 0 ms 2023-10-30 14:54:48,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:48,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-30 14:54:48,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:48,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for bb4420255160505884d9c82dfe0aed2b: 2023-10-30 14:54:48,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:48,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:48,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ae1fa8048a3a8e4b39683c8300846593, disabling compactions & flushes 2023-10-30 14:54:48,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:48,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:48,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. after waiting 0 ms 2023-10-30 14:54:48,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:48,054 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=bb4420255160505884d9c82dfe0aed2b, regionState=CLOSED 2023-10-30 14:54:48,054 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698677688054"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677688054"}]},"ts":"1698677688054"} 2023-10-30 14:54:48,057 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-10-30 14:54:48,058 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure bb4420255160505884d9c82dfe0aed2b, server=jenkins-hbase20.apache.org,36359,1698677568317 in 170 msec 2023-10-30 14:54:48,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-30 14:54:48,058 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb4420255160505884d9c82dfe0aed2b, UNASSIGN in 175 msec 2023-10-30 14:54:48,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:48,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ae1fa8048a3a8e4b39683c8300846593: 2023-10-30 14:54:48,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:48,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:48,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 177e982e175e289e7a05a97bd09698ab, disabling compactions & flushes 2023-10-30 14:54:48,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:48,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:48,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. after waiting 0 ms 2023-10-30 14:54:48,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:48,061 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=ae1fa8048a3a8e4b39683c8300846593, regionState=CLOSED 2023-10-30 14:54:48,061 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698677688061"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677688061"}]},"ts":"1698677688061"} 2023-10-30 14:54:48,065 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=89 2023-10-30 14:54:48,065 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure ae1fa8048a3a8e4b39683c8300846593, server=jenkins-hbase20.apache.org,36359,1698677568317 in 176 msec 2023-10-30 14:54:48,066 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ae1fa8048a3a8e4b39683c8300846593, UNASSIGN in 182 msec 2023-10-30 14:54:48,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-30 14:54:48,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:48,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 177e982e175e289e7a05a97bd09698ab: 2023-10-30 14:54:48,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:48,069 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=177e982e175e289e7a05a97bd09698ab, regionState=CLOSED 2023-10-30 14:54:48,069 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698677688068"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677688068"}]},"ts":"1698677688068"} 2023-10-30 14:54:48,071 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-10-30 14:54:48,071 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; CloseRegionProcedure 177e982e175e289e7a05a97bd09698ab, server=jenkins-hbase20.apache.org,36359,1698677568317 in 183 msec 2023-10-30 14:54:48,072 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=88 2023-10-30 14:54:48,072 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=177e982e175e289e7a05a97bd09698ab, UNASSIGN in 188 msec 2023-10-30 14:54:48,072 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677688072"}]},"ts":"1698677688072"} 2023-10-30 14:54:48,073 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-10-30 14:54:48,074 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-10-30 14:54:48,075 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 196 msec 2023-10-30 14:54:48,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-30 14:54:48,184 INFO [Listener at localhost/34621] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-10-30 14:54:48,199 INFO [Listener at localhost/34621] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1698677675181-1698677688199 2023-10-30 14:54:48,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=hbase-failsafe-snaptb-1698677675181-1698677688199 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 14:54:48,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698677688200 (current time:1698677688200). 2023-10-30 14:54:48,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-30 14:54:48,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] zookeeper.ReadOnlyZKClient(139): Connect 0x272c50e6 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:54:48,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26ba567e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:54:48,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:54:48,209 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:54:48,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x272c50e6 to 127.0.0.1:49804 2023-10-30 14:54:48,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:54:48,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-30 14:54:48,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1698677675181-1698677688199 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 14:54:48,213 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.hbase-snapshot, current working dir path: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698677675181-1698677688199 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-30 14:54:48,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 14:54:48,217 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 14:54:48,217 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698678288217 2023-10-30 14:54:48,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1698677675181-1698677688199 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 14:54:48,217 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1698677675181-1698677688199 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-10-30 14:54:48,218 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1698677675181-1698677688199 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:48,218 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-30 14:54:48,318 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 14:54:48,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698677675181-1698677688199 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 14:54:48,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698677675181-1698677688199 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 14:54:48,320 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-30 14:54:48,521 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 14:54:48,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698677675181-1698677688199 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 14:54:48,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698677675181-1698677688199 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 14:54:48,525 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-30 14:54:48,626 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698677675181-1698677688199 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-10-30 14:54:48,628 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-30 14:54:48,628 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-30 14:54:48,629 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-30 14:54:48,628 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-30 14:54:48,629 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-30 14:54:48,629 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-30 14:54:48,629 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-30 14:54:48,629 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-30 14:54:48,634 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/7c58195607a94edea82c578a1da8508e_SeqId_29_, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/9c263ecd8672494fb8067d5029d24e77] hfiles 2023-10-30 14:54:48,634 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/7c58195607a94edea82c578a1da8508e_SeqId_29_ 2023-10-30 14:54:48,634 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/9c263ecd8672494fb8067d5029d24e77 2023-10-30 14:54:48,634 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/687f02926d3445d8abbc37faa93f4572, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/c220192ac67f49b4999b2c8b66a89b27_SeqId_29_] hfiles 2023-10-30 14:54:48,634 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/687f02926d3445d8abbc37faa93f4572 2023-10-30 14:54:48,634 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/c220192ac67f49b4999b2c8b66a89b27_SeqId_29_ 2023-10-30 14:54:48,635 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/83bc99b049504a00942b42a2e23a8b02_SeqId_29_, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/c1940cd487e14ce09c99888dad24d38d] hfiles 2023-10-30 14:54:48,635 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/83bc99b049504a00942b42a2e23a8b02_SeqId_29_ 2023-10-30 14:54:48,635 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/c1940cd487e14ce09c99888dad24d38d 2023-10-30 14:54:48,635 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023103014267d9715f942708139b667831e1c54, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310309b66b0c95aaf4a478da650eaee528f65, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030cf27bffba56d45bdbfc36ff48f6d1402] hfiles 2023-10-30 14:54:48,635 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023103014267d9715f942708139b667831e1c54 2023-10-30 14:54:48,635 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/0372d4f966d1436ba34e74d12e9f83e7] hfiles 2023-10-30 14:54:48,635 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310309b66b0c95aaf4a478da650eaee528f65 2023-10-30 14:54:48,635 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/0372d4f966d1436ba34e74d12e9f83e7 2023-10-30 14:54:48,635 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030cf27bffba56d45bdbfc36ff48f6d1402 2023-10-30 14:54:48,635 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/c4ba4a8f3149438197ed73940bdbf674] hfiles 2023-10-30 14:54:48,635 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/cadc094e9bef43d882e4b9be65f5286d] hfiles 2023-10-30 14:54:48,635 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/c4ba4a8f3149438197ed73940bdbf674 2023-10-30 14:54:48,635 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/cadc094e9bef43d882e4b9be65f5286d 2023-10-30 14:54:48,647 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103012f1a5e1fd2d4d70a013c31616b361e8, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103052fd2e67195e4f6f9006d3325678bf5c, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310306772845d1c4c4d1aaca156189645a9e1_del, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103094ab3781d55c4d569f11c57573387312, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030ea4d8161e3aa4ce68f1fca34a2462d2b, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310302d3e6fd4fecc43f89661bda688f12df4, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310306ef6ebc6de7c4d5ca232e7cd0e3df1e7_del, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030791e633deb98414c93b811cadfb7a168, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030d938a4ee2e9f4c97aff9b4533d19701d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030f33973934ce04cf78eb06ec5d534f99f, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103046af05a6db584b00b23ab31e8a185b65, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310304d0a7814543843f59835dc40266c0b68, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103057b53ec6a60f4484a8d7572c7206f4e1, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030ca9ac6bbcd04437eb3fc932fa427010b_del, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030e8d2f245f5744ce3b46aa355a2b27cb2] hfiles 2023-10-30 14:54:48,647 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103012f1a5e1fd2d4d70a013c31616b361e8 2023-10-30 14:54:48,647 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103052fd2e67195e4f6f9006d3325678bf5c 2023-10-30 14:54:48,647 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310306772845d1c4c4d1aaca156189645a9e1_del 2023-10-30 14:54:48,647 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103094ab3781d55c4d569f11c57573387312 2023-10-30 14:54:48,647 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030ea4d8161e3aa4ce68f1fca34a2462d2b 2023-10-30 14:54:48,647 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310302d3e6fd4fecc43f89661bda688f12df4 2023-10-30 14:54:48,647 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310306ef6ebc6de7c4d5ca232e7cd0e3df1e7_del 2023-10-30 14:54:48,647 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030791e633deb98414c93b811cadfb7a168 2023-10-30 14:54:48,647 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030d938a4ee2e9f4c97aff9b4533d19701d 2023-10-30 14:54:48,647 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030f33973934ce04cf78eb06ec5d534f99f 2023-10-30 14:54:48,647 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103046af05a6db584b00b23ab31e8a185b65 2023-10-30 14:54:48,647 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310304d0a7814543843f59835dc40266c0b68 2023-10-30 14:54:48,648 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103057b53ec6a60f4484a8d7572c7206f4e1 2023-10-30 14:54:48,648 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030ca9ac6bbcd04437eb3fc932fa427010b_del 2023-10-30 14:54:48,648 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030e8d2f245f5744ce3b46aa355a2b27cb2 2023-10-30 14:54:48,825 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 14:54:48,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698677675181-1698677688199 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 14:54:48,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698677675181-1698677688199 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 14:54:48,826 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-30 14:54:49,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1698677675181-1698677688199 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-10-30 14:54:49,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1698677675181-1698677688199 2023-10-30 14:54:49,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698677675181-1698677688199 2023-10-30 14:54:49,327 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 14:54:49,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698677675181-1698677688199 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 14:54:49,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698677675181-1698677688199 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 14:54:49,330 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-30 14:54:49,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698677675181-1698677688199 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.hbase-snapshot/hbase-failsafe-snaptb-1698677675181-1698677688199 2023-10-30 14:54:49,496 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1698677675181-1698677688199 of table testCompactionWithHFileLink completed 2023-10-30 14:54:49,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698677675181-1698677688199 2023-10-30 14:54:49,496 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698677675181-1698677688199 2023-10-30 14:54:49,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1698677675181-1698677688199 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698677688218Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698677675181-1698677688199 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1698677688626 (+408 ms)Consolidate snapshot: hbase-failsafe-snaptb-1698677675181-1698677688199 at 1698677689058 (+432 ms)Loading Region manifests for hbase-failsafe-snaptb-1698677675181-1698677688199 at 1698677689059 (+1 ms)Writing data manifest for hbase-failsafe-snaptb-1698677675181-1698677688199 at 1698677689067 (+8 ms)Verifying snapshot: hbase-failsafe-snaptb-1698677675181-1698677688199 at 1698677689477 (+410 ms)Snapshot hbase-failsafe-snaptb-1698677675181-1698677688199 of table testCompactionWithHFileLink completed at 1698677689496 (+19 ms) 2023-10-30 14:54:49,497 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 14:54:49,499 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2830 sec 2023-10-30 14:54:50,330 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 14:54:50,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698677675181-1698677688199 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 14:54:50,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1698677675181-1698677688199 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-30 14:54:50,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698677675181" table: "testCompactionWithHFileLink" creation_time: 1698677675190 type: FLUSH version: 2 ttl: 0 ) 2023-10-30 14:54:50,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1698677675181 as table=testCompactionWithHFileLink 2023-10-30 14:54:50,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-30 14:54:50,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-30 14:54:50,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-30 14:54:50,788 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-10-30 14:54:50,789 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-10-30 14:54:50,790 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-10-30 14:54:50,790 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1698677675181 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 14:54:50,795 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1698677675181" table: "testCompactionWithHFileLink" creation_time: 1698677675190 type: FLUSH version: 2 ttl: 0 2023-10-30 14:54:50,795 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink 2023-10-30 14:54:50,801 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-10-30 14:54:50,805 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030cf27bffba56d45bdbfc36ff48f6d1402 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030cf27bffba56d45bdbfc36ff48f6d1402 2023-10-30 14:54:50,806 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023103014267d9715f942708139b667831e1c54 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023103014267d9715f942708139b667831e1c54 2023-10-30 14:54:50,807 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310309b66b0c95aaf4a478da650eaee528f65 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310309b66b0c95aaf4a478da650eaee528f65 2023-10-30 14:54:50,807 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231030306a95190aca471bb3fb90e9afe4c1b6 of snapshot=snaptb-1698677675181 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 14:54:50,810 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202310305b7e2588a2fd4fcf855be950885822ae of snapshot=snaptb-1698677675181 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 14:54:50,814 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202310305d4c36e04d25494ebee0c2aca172e077 of snapshot=snaptb-1698677675181 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 14:54:50,817 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231030652fa08d7eaa489aa53112a25e4c6e52 of snapshot=snaptb-1698677675181 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 14:54:50,821 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023103064f18b070bd6417b970ba5bf25812d1b of snapshot=snaptb-1698677675181 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 14:54:50,824 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231030ad4c64c2896f4546ba4520b49f1c1bfe of snapshot=snaptb-1698677675181 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 14:54:50,828 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231030d85f81458f234c52accfe89b5cc77d13 of snapshot=snaptb-1698677675181 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 14:54:50,831 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231030f6643351702042038f9dd4acd6531b12 of snapshot=snaptb-1698677675181 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 14:54:50,834 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202310301d84ee4c3d9b4d14a880aaa505aaffa5 of snapshot=snaptb-1698677675181 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 14:54:50,837 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202310306b07bd1b692b4ae08c74af088fe0fb4c of snapshot=snaptb-1698677675181 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 14:54:50,840 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023103081d39d6093c24c6089bddb6c87ad0027 of snapshot=snaptb-1698677675181 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 14:54:50,843 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231030d4476e19c8584a6ba1a6034376399e72 of snapshot=snaptb-1698677675181 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 14:54:50,848 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310306772845d1c4c4d1aaca156189645a9e1_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310306772845d1c4c4d1aaca156189645a9e1_del 2023-10-30 14:54:50,849 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030ca9ac6bbcd04437eb3fc932fa427010b_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030ca9ac6bbcd04437eb3fc932fa427010b_del 2023-10-30 14:54:50,850 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310306ef6ebc6de7c4d5ca232e7cd0e3df1e7_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310306ef6ebc6de7c4d5ca232e7cd0e3df1e7_del 2023-10-30 14:54:50,850 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:50,850 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:50,850 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:50,853 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/7c58195607a94edea82c578a1da8508e_SeqId_29_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/7c58195607a94edea82c578a1da8508e_SeqId_29_ 2023-10-30 14:54:50,853 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/c1940cd487e14ce09c99888dad24d38d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/c1940cd487e14ce09c99888dad24d38d 2023-10-30 14:54:50,853 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/687f02926d3445d8abbc37faa93f4572 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/687f02926d3445d8abbc37faa93f4572 2023-10-30 14:54:50,858 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/9c263ecd8672494fb8067d5029d24e77 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/9c263ecd8672494fb8067d5029d24e77 2023-10-30 14:54:50,859 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 759e3982aa854502a1ce7acd8e912e27 of snapshot=snaptb-1698677675181 to region=bb4420255160505884d9c82dfe0aed2b table=testCompactionWithHFileLink 2023-10-30 14:54:50,859 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/c220192ac67f49b4999b2c8b66a89b27_SeqId_29_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/c220192ac67f49b4999b2c8b66a89b27_SeqId_29_ 2023-10-30 14:54:50,859 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 295e1e182a8645f2b8e4c0bbbd048585 of snapshot=snaptb-1698677675181 to region=ae1fa8048a3a8e4b39683c8300846593 table=testCompactionWithHFileLink 2023-10-30 14:54:50,859 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/83bc99b049504a00942b42a2e23a8b02_SeqId_29_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/83bc99b049504a00942b42a2e23a8b02_SeqId_29_ 2023-10-30 14:54:50,859 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2b47a1baeecd4aa1ad0a3c96868a7d18 of snapshot=snaptb-1698677675181 to region=177e982e175e289e7a05a97bd09698ab table=testCompactionWithHFileLink 2023-10-30 14:54:50,874 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink aa621a482a484c03adc30abe5de75ad6 of snapshot=snaptb-1698677675181 to region=177e982e175e289e7a05a97bd09698ab table=testCompactionWithHFileLink 2023-10-30 14:54:50,874 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ea958de57c9f4ab68aced0e68b1dc78e of snapshot=snaptb-1698677675181 to region=bb4420255160505884d9c82dfe0aed2b table=testCompactionWithHFileLink 2023-10-30 14:54:50,874 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b598326d3877443f8a5c2ce183ba1ced of snapshot=snaptb-1698677675181 to region=ae1fa8048a3a8e4b39683c8300846593 table=testCompactionWithHFileLink 2023-10-30 14:54:50,878 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4808a5156fa94e7fae3d06858c38b36e of snapshot=snaptb-1698677675181 to region=ae1fa8048a3a8e4b39683c8300846593 table=testCompactionWithHFileLink 2023-10-30 14:54:50,878 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f74278cae04e42c2964dcd29438480ca of snapshot=snaptb-1698677675181 to region=bb4420255160505884d9c82dfe0aed2b table=testCompactionWithHFileLink 2023-10-30 14:54:50,879 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ab92fff50dab4ae2982dd62a74c7a087 of snapshot=snaptb-1698677675181 to region=177e982e175e289e7a05a97bd09698ab table=testCompactionWithHFileLink 2023-10-30 14:54:50,885 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cb4f7beb9e6145b69a78a38546bb4fc5 of snapshot=snaptb-1698677675181 to region=bb4420255160505884d9c82dfe0aed2b table=testCompactionWithHFileLink 2023-10-30 14:54:50,885 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ad30394daddd43ab8c1062194de0e1e9 of snapshot=snaptb-1698677675181 to region=177e982e175e289e7a05a97bd09698ab table=testCompactionWithHFileLink 2023-10-30 14:54:50,885 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink de1b296614cb4a1fbc6d3967bac55140 of snapshot=snaptb-1698677675181 to region=ae1fa8048a3a8e4b39683c8300846593 table=testCompactionWithHFileLink 2023-10-30 14:54:50,904 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/0372d4f966d1436ba34e74d12e9f83e7 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/0372d4f966d1436ba34e74d12e9f83e7 2023-10-30 14:54:50,904 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 581a155e7d464babbdeafdaab27919b1 of snapshot=snaptb-1698677675181 to region=bb4420255160505884d9c82dfe0aed2b table=testCompactionWithHFileLink 2023-10-30 14:54:50,905 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/c4ba4a8f3149438197ed73940bdbf674 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/c4ba4a8f3149438197ed73940bdbf674 2023-10-30 14:54:50,905 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/cadc094e9bef43d882e4b9be65f5286d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/cadc094e9bef43d882e4b9be65f5286d 2023-10-30 14:54:50,905 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a894379bbf574430a9752a8e8fe13ea4 of snapshot=snaptb-1698677675181 to region=ae1fa8048a3a8e4b39683c8300846593 table=testCompactionWithHFileLink 2023-10-30 14:54:50,905 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 53bcf2454ffe4417923cc96b7a80572d of snapshot=snaptb-1698677675181 to region=177e982e175e289e7a05a97bd09698ab table=testCompactionWithHFileLink 2023-10-30 14:54:50,916 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 401ae32ee6274f79bd17dc7a11d6b617 of snapshot=snaptb-1698677675181 to region=bb4420255160505884d9c82dfe0aed2b table=testCompactionWithHFileLink 2023-10-30 14:54:50,916 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 54b63ff7f107495b9b03d1485db0e3c4 of snapshot=snaptb-1698677675181 to region=177e982e175e289e7a05a97bd09698ab table=testCompactionWithHFileLink 2023-10-30 14:54:50,916 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 32bfccbe5e7f4ffa98cc1d1b8f0aa0d5 of snapshot=snaptb-1698677675181 to region=ae1fa8048a3a8e4b39683c8300846593 table=testCompactionWithHFileLink 2023-10-30 14:54:50,922 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink deff8397ffde4b2480faeb0b70f4f9c3 of snapshot=snaptb-1698677675181 to region=bb4420255160505884d9c82dfe0aed2b table=testCompactionWithHFileLink 2023-10-30 14:54:50,923 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 842819db31bd40db9555b648b51e83e3 of snapshot=snaptb-1698677675181 to region=177e982e175e289e7a05a97bd09698ab table=testCompactionWithHFileLink 2023-10-30 14:54:50,923 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2585357f0708418eb01e1e185092d495 of snapshot=snaptb-1698677675181 to region=ae1fa8048a3a8e4b39683c8300846593 table=testCompactionWithHFileLink 2023-10-30 14:54:50,926 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a71b6279cb934faf9d40886373be5d6d of snapshot=snaptb-1698677675181 to region=bb4420255160505884d9c82dfe0aed2b table=testCompactionWithHFileLink 2023-10-30 14:54:50,926 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 49944bc1a53c4289b0eb4d14a1ba38a7 of snapshot=snaptb-1698677675181 to region=177e982e175e289e7a05a97bd09698ab table=testCompactionWithHFileLink 2023-10-30 14:54:50,926 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a37fba37977a400b9a368a162f1a8993 of snapshot=snaptb-1698677675181 to region=ae1fa8048a3a8e4b39683c8300846593 table=testCompactionWithHFileLink 2023-10-30 14:54:50,932 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1698677675181" table: "testCompactionWithHFileLink" creation_time: 1698677675190 type: FLUSH version: 2 ttl: 0 2023-10-30 14:54:50,933 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698677690933"}]},"ts":"9223372036854775807"} 2023-10-30 14:54:50,933 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698677690933"}]},"ts":"9223372036854775807"} 2023-10-30 14:54:50,933 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698677690933"}]},"ts":"9223372036854775807"} 2023-10-30 14:54:50,934 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-10-30 14:54:50,934 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 177e982e175e289e7a05a97bd09698ab, NAME => 'testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => ae1fa8048a3a8e4b39683c8300846593, NAME => 'testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bb4420255160505884d9c82dfe0aed2b, NAME => 'testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.', STARTKEY => '1', ENDKEY => '2'}] 2023-10-30 14:54:50,935 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698677690934"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677690934"}]},"ts":"1698677690934"} 2023-10-30 14:54:50,935 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698677690934"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677690934"}]},"ts":"1698677690934"} 2023-10-30 14:54:50,935 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698677690934"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677690934"}]},"ts":"1698677690934"} 2023-10-30 14:54:50,936 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-30 14:54:50,936 INFO [PEWorker-5] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-10-30 14:54:50,936 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 177e982e175e289e7a05a97bd09698ab, NAME => 'testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => ae1fa8048a3a8e4b39683c8300846593, NAME => 'testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bb4420255160505884d9c82dfe0aed2b, NAME => 'testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.', STARTKEY => '1', ENDKEY => '2'}] 2023-10-30 14:54:50,937 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1698677675181 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-10-30 14:54:50,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698677675181" table: "testCompactionWithHFileLink" creation_time: 1698677675190 type: FLUSH version: 2 ttl: 0 ) in 568 msec 2023-10-30 14:54:50,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-30 14:54:50,983 INFO [Listener at localhost/34621] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-10-30 14:54:50,984 INFO [Listener at localhost/34621] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1698677675181-1698677688199 2023-10-30 14:54:50,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "hbase-failsafe-snaptb-1698677675181-1698677688199" 2023-10-30 14:54:50,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1698677675181-1698677688199 2023-10-30 14:54:50,992 INFO [Listener at localhost/34621] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-10-30 14:54:50,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$10(2385): Client=jenkins//148.251.75.209 enable testCompactionWithHFileLink 2023-10-30 14:54:51,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-10-30 14:54:51,004 INFO [PEWorker-4] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-10-30 14:54:51,004 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677691004"}]},"ts":"1698677691004"} 2023-10-30 14:54:51,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-30 14:54:51,005 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-10-30 14:54:51,007 DEBUG [PEWorker-4] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-10-30 14:54:51,007 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ae1fa8048a3a8e4b39683c8300846593, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb4420255160505884d9c82dfe0aed2b, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=177e982e175e289e7a05a97bd09698ab, ASSIGN}] 2023-10-30 14:54:51,008 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ae1fa8048a3a8e4b39683c8300846593, ASSIGN 2023-10-30 14:54:51,008 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb4420255160505884d9c82dfe0aed2b, ASSIGN 2023-10-30 14:54:51,008 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=177e982e175e289e7a05a97bd09698ab, ASSIGN 2023-10-30 14:54:51,009 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ae1fa8048a3a8e4b39683c8300846593, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-30 14:54:51,009 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb4420255160505884d9c82dfe0aed2b, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-30 14:54:51,009 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=177e982e175e289e7a05a97bd09698ab, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-30 14:54:51,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-30 14:54:51,161 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=177e982e175e289e7a05a97bd09698ab, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:51,161 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=ae1fa8048a3a8e4b39683c8300846593, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:51,161 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698677691161"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677691161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677691161"}]},"ts":"1698677691161"} 2023-10-30 14:54:51,161 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698677691161"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677691161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677691161"}]},"ts":"1698677691161"} 2023-10-30 14:54:51,161 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=bb4420255160505884d9c82dfe0aed2b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:51,161 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698677691161"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677691161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677691161"}]},"ts":"1698677691161"} 2023-10-30 14:54:51,163 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure 177e982e175e289e7a05a97bd09698ab, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:51,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure ae1fa8048a3a8e4b39683c8300846593, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:51,165 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure bb4420255160505884d9c82dfe0aed2b, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:51,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-30 14:54:51,315 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:51,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:51,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb4420255160505884d9c82dfe0aed2b, NAME => 'testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.', STARTKEY => '1', ENDKEY => '2'} 2023-10-30 14:54:51,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:51,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:51,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:51,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:51,324 INFO [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:51,326 DEBUG [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1 2023-10-30 14:54:51,326 DEBUG [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1 2023-10-30 14:54:51,326 INFO [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb4420255160505884d9c82dfe0aed2b columnFamilyName family1 2023-10-30 14:54:51,343 DEBUG [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-759e3982aa854502a1ce7acd8e912e27 2023-10-30 14:54:51,351 DEBUG [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-cb4f7beb9e6145b69a78a38546bb4fc5 2023-10-30 14:54:51,358 DEBUG [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-ea958de57c9f4ab68aced0e68b1dc78e 2023-10-30 14:54:51,364 DEBUG [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-f74278cae04e42c2964dcd29438480ca 2023-10-30 14:54:51,364 INFO [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] regionserver.HStore(310): Store=bb4420255160505884d9c82dfe0aed2b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:51,365 INFO [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:51,366 DEBUG [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2 2023-10-30 14:54:51,366 DEBUG [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2 2023-10-30 14:54:51,367 INFO [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb4420255160505884d9c82dfe0aed2b columnFamilyName family2 2023-10-30 14:54:51,376 DEBUG [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-401ae32ee6274f79bd17dc7a11d6b617 2023-10-30 14:54:51,381 DEBUG [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-581a155e7d464babbdeafdaab27919b1 2023-10-30 14:54:51,386 DEBUG [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-a71b6279cb934faf9d40886373be5d6d 2023-10-30 14:54:51,392 DEBUG [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-deff8397ffde4b2480faeb0b70f4f9c3 2023-10-30 14:54:51,392 INFO [StoreOpener-bb4420255160505884d9c82dfe0aed2b-1] regionserver.HStore(310): Store=bb4420255160505884d9c82dfe0aed2b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:51,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:51,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:51,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 14:54:51,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:54:51,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened bb4420255160505884d9c82dfe0aed2b; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68827572, jitterRate=0.025610744953155518}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 14:54:51,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for bb4420255160505884d9c82dfe0aed2b: 2023-10-30 14:54:51,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b., pid=103, masterSystemTime=1698677691315 2023-10-30 14:54:51,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:54:51,399 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-30 14:54:51,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-30 14:54:51,399 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-30 14:54:51,401 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=bb4420255160505884d9c82dfe0aed2b, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:51,401 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698677691401"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677691401"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677691401"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677691401"}]},"ts":"1698677691401"} 2023-10-30 14:54:51,402 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-30 14:54:51,402 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HStore(1912): bb4420255160505884d9c82dfe0aed2b/family2 is initiating minor compaction (all files) 2023-10-30 14:54:51,402 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HRegion(2259): Starting compaction of bb4420255160505884d9c82dfe0aed2b/family2 in testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:51,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:51,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:51,403 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-581a155e7d464babbdeafdaab27919b1, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-401ae32ee6274f79bd17dc7a11d6b617, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-deff8397ffde4b2480faeb0b70f4f9c3, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-a71b6279cb934faf9d40886373be5d6d] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp, totalSize=20.4 K 2023-10-30 14:54:51,403 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-30 14:54:51,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:51,403 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1912): bb4420255160505884d9c82dfe0aed2b/family1 is initiating minor compaction (all files) 2023-10-30 14:54:51,403 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of bb4420255160505884d9c82dfe0aed2b/family1 in testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:54:51,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 177e982e175e289e7a05a97bd09698ab, NAME => 'testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.', STARTKEY => '2', ENDKEY => ''} 2023-10-30 14:54:51,403 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-759e3982aa854502a1ce7acd8e912e27, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-ea958de57c9f4ab68aced0e68b1dc78e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-f74278cae04e42c2964dcd29438480ca, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-cb4f7beb9e6145b69a78a38546bb4fc5] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp, totalSize=21.6 K 2023-10-30 14:54:51,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:51,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:51,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:51,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:51,404 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-581a155e7d464babbdeafdaab27919b1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677668183 2023-10-30 14:54:51,404 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-759e3982aa854502a1ce7acd8e912e27, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677668183 2023-10-30 14:54:51,405 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-401ae32ee6274f79bd17dc7a11d6b617, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677670013 2023-10-30 14:54:51,405 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=99 2023-10-30 14:54:51,405 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-ea958de57c9f4ab68aced0e68b1dc78e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677670013 2023-10-30 14:54:51,405 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure bb4420255160505884d9c82dfe0aed2b, server=jenkins-hbase20.apache.org,36359,1698677568317 in 238 msec 2023-10-30 14:54:51,405 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-f74278cae04e42c2964dcd29438480ca, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677671839 2023-10-30 14:54:51,406 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-deff8397ffde4b2480faeb0b70f4f9c3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677671839 2023-10-30 14:54:51,406 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-cb4f7beb9e6145b69a78a38546bb4fc5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677673772 2023-10-30 14:54:51,406 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb4420255160505884d9c82dfe0aed2b, ASSIGN in 398 msec 2023-10-30 14:54:51,406 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-a71b6279cb934faf9d40886373be5d6d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677673772 2023-10-30 14:54:51,413 INFO [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:51,414 DEBUG [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1 2023-10-30 14:54:51,414 DEBUG [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1 2023-10-30 14:54:51,415 INFO [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 177e982e175e289e7a05a97bd09698ab columnFamilyName family1 2023-10-30 14:54:51,430 DEBUG [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-2b47a1baeecd4aa1ad0a3c96868a7d18 2023-10-30 14:54:51,441 DEBUG [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-aa621a482a484c03adc30abe5de75ad6 2023-10-30 14:54:51,446 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] throttle.PressureAwareThroughputController(145): bb4420255160505884d9c82dfe0aed2b#family2#compaction#114 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:54:51,447 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] throttle.PressureAwareThroughputController(145): bb4420255160505884d9c82dfe0aed2b#family1#compaction#115 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:54:51,450 DEBUG [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-ab92fff50dab4ae2982dd62a74c7a087 2023-10-30 14:54:51,466 DEBUG [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-ad30394daddd43ab8c1062194de0e1e9 2023-10-30 14:54:51,466 INFO [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] regionserver.HStore(310): Store=177e982e175e289e7a05a97bd09698ab/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:51,466 INFO [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:51,467 DEBUG [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2 2023-10-30 14:54:51,467 DEBUG [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2 2023-10-30 14:54:51,468 INFO [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 177e982e175e289e7a05a97bd09698ab columnFamilyName family2 2023-10-30 14:54:51,474 DEBUG [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-49944bc1a53c4289b0eb4d14a1ba38a7 2023-10-30 14:54:51,478 DEBUG [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-53bcf2454ffe4417923cc96b7a80572d 2023-10-30 14:54:51,484 DEBUG [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-54b63ff7f107495b9b03d1485db0e3c4 2023-10-30 14:54:51,489 DEBUG [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-842819db31bd40db9555b648b51e83e3 2023-10-30 14:54:51,489 INFO [StoreOpener-177e982e175e289e7a05a97bd09698ab-1] regionserver.HStore(310): Store=177e982e175e289e7a05a97bd09698ab/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:51,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:51,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:51,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 14:54:51,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 177e982e175e289e7a05a97bd09698ab 2023-10-30 14:54:51,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 177e982e175e289e7a05a97bd09698ab; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67613063, jitterRate=0.007513150572776794}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 14:54:51,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 177e982e175e289e7a05a97bd09698ab: 2023-10-30 14:54:51,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab., pid=101, masterSystemTime=1698677691315 2023-10-30 14:54:51,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-30 14:54:51,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-10-30 14:54:51,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:51,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:51,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:51,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ae1fa8048a3a8e4b39683c8300846593, NAME => 'testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.', STARTKEY => '', ENDKEY => '1'} 2023-10-30 14:54:51,497 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=177e982e175e289e7a05a97bd09698ab, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:51,497 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698677691497"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677691497"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677691497"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677691497"}]},"ts":"1698677691497"} 2023-10-30 14:54:51,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:51,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:51,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:51,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:51,498 INFO [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:51,499 DEBUG [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1 2023-10-30 14:54:51,499 DEBUG [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1 2023-10-30 14:54:51,500 INFO [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae1fa8048a3a8e4b39683c8300846593 columnFamilyName family1 2023-10-30 14:54:51,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=100 2023-10-30 14:54:51,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure 177e982e175e289e7a05a97bd09698ab, server=jenkins-hbase20.apache.org,36359,1698677568317 in 336 msec 2023-10-30 14:54:51,501 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=177e982e175e289e7a05a97bd09698ab, ASSIGN in 493 msec 2023-10-30 14:54:51,507 DEBUG [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-295e1e182a8645f2b8e4c0bbbd048585 2023-10-30 14:54:51,514 DEBUG [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-4808a5156fa94e7fae3d06858c38b36e 2023-10-30 14:54:51,522 DEBUG [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-b598326d3877443f8a5c2ce183ba1ced 2023-10-30 14:54:51,529 DEBUG [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-de1b296614cb4a1fbc6d3967bac55140 2023-10-30 14:54:51,529 INFO [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] regionserver.HStore(310): Store=ae1fa8048a3a8e4b39683c8300846593/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:51,530 INFO [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:51,531 DEBUG [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2 2023-10-30 14:54:51,531 DEBUG [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2 2023-10-30 14:54:51,531 INFO [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae1fa8048a3a8e4b39683c8300846593 columnFamilyName family2 2023-10-30 14:54:51,540 DEBUG [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-2585357f0708418eb01e1e185092d495 2023-10-30 14:54:51,546 DEBUG [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-32bfccbe5e7f4ffa98cc1d1b8f0aa0d5 2023-10-30 14:54:51,553 DEBUG [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-a37fba37977a400b9a368a162f1a8993 2023-10-30 14:54:51,560 DEBUG [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] regionserver.HStore(539): loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-a894379bbf574430a9752a8e8fe13ea4 2023-10-30 14:54:51,560 INFO [StoreOpener-ae1fa8048a3a8e4b39683c8300846593-1] regionserver.HStore(310): Store=ae1fa8048a3a8e4b39683c8300846593/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:51,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:51,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:51,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 14:54:51,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:54:51,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ae1fa8048a3a8e4b39683c8300846593; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73600573, jitterRate=0.09673400223255157}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 14:54:51,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ae1fa8048a3a8e4b39683c8300846593: 2023-10-30 14:54:51,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593., pid=102, masterSystemTime=1698677691315 2023-10-30 14:54:51,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-10-30 14:54:51,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-10-30 14:54:51,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:51,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:51,567 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=ae1fa8048a3a8e4b39683c8300846593, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:51,567 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698677691567"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677691567"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677691567"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677691567"}]},"ts":"1698677691567"} 2023-10-30 14:54:51,570 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=98 2023-10-30 14:54:51,570 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure ae1fa8048a3a8e4b39683c8300846593, server=jenkins-hbase20.apache.org,36359,1698677568317 in 404 msec 2023-10-30 14:54:51,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=98, resume processing ppid=97 2023-10-30 14:54:51,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ae1fa8048a3a8e4b39683c8300846593, ASSIGN in 563 msec 2023-10-30 14:54:51,571 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677691571"}]},"ts":"1698677691571"} 2023-10-30 14:54:51,572 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-10-30 14:54:51,573 INFO [PEWorker-2] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-10-30 14:54:51,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 577 msec 2023-10-30 14:54:51,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-30 14:54:51,610 INFO [Listener at localhost/34621] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-10-30 14:54:51,623 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:54:51,629 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:54:51,641 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:54:51,642 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:54:51,648 INFO [Listener at localhost/34621] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 14:54:51,662 INFO [Listener at localhost/34621] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-10-30 14:54:51,662 INFO [Listener at localhost/34621] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-10-30 14:54:51,663 DEBUG [Listener at localhost/34621] zookeeper.ReadOnlyZKClient(139): Connect 0x46c98c6b to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:54:51,667 DEBUG [Listener at localhost/34621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50043056, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:54:51,668 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 14:54:51,668 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 14:54:51,668 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 14:54:51,752 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103085e88c6128924c6abba17d69c7fb2df8 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023103085e88c6128924c6abba17d69c7fb2df8 2023-10-30 14:54:51,752 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 14:54:51,763 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:54:51,766 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:54:51,772 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 14:54:51,775 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 14:54:51,787 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/ecc5ce98f3d348119b2c46c0a6767b0f first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-10-30 14:54:51,787 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/ecc5ce98f3d348119b2c46c0a6767b0f}] 2023-10-30 14:54:51,793 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/ecc5ce98f3d348119b2c46c0a6767b0f for inclusion in bb4420255160505884d9c82dfe0aed2b/family1 2023-10-30 14:54:51,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-10-30 14:54:51,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-30 14:54:51,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for bb4420255160505884d9c82dfe0aed2b: 2023-10-30 14:54:51,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/ecc5ce98f3d348119b2c46c0a6767b0f to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__bggp64p0v7fhlv79l29c5r7mn2a7soi1r31debvid6adv5iul4bkvjabrv42c7rh/family1/ecc5ce98f3d348119b2c46c0a6767b0f 2023-10-30 14:54:51,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__bggp64p0v7fhlv79l29c5r7mn2a7soi1r31debvid6adv5iul4bkvjabrv42c7rh/family1/ecc5ce98f3d348119b2c46c0a6767b0f as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/4672edf4313f4bc7808eb4006fb4ee58_SeqId_34_ 2023-10-30 14:54:51,799 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__bggp64p0v7fhlv79l29c5r7mn2a7soi1r31debvid6adv5iul4bkvjabrv42c7rh/family1/ecc5ce98f3d348119b2c46c0a6767b0f into bb4420255160505884d9c82dfe0aed2b/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/4672edf4313f4bc7808eb4006fb4ee58_SeqId_34_ - updating store file list. 2023-10-30 14:54:51,803 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/4672edf4313f4bc7808eb4006fb4ee58_SeqId_34_ into bb4420255160505884d9c82dfe0aed2b/family1 2023-10-30 14:54:51,803 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__bggp64p0v7fhlv79l29c5r7mn2a7soi1r31debvid6adv5iul4bkvjabrv42c7rh/family1/ecc5ce98f3d348119b2c46c0a6767b0f into bb4420255160505884d9c82dfe0aed2b/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/4672edf4313f4bc7808eb4006fb4ee58_SeqId_34_) 2023-10-30 14:54:51,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__bggp64p0v7fhlv79l29c5r7mn2a7soi1r31debvid6adv5iul4bkvjabrv42c7rh/family1/ecc5ce98f3d348119b2c46c0a6767b0f 2023-10-30 14:54:51,805 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 14:54:51,806 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:51,807 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231030306a95190aca471bb3fb90e9afe4c1b6 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231030306a95190aca471bb3fb90e9afe4c1b6 2023-10-30 14:54:51,808 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310305b7e2588a2fd4fcf855be950885822ae to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310305b7e2588a2fd4fcf855be950885822ae 2023-10-30 14:54:51,808 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310305d4c36e04d25494ebee0c2aca172e077 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310305d4c36e04d25494ebee0c2aca172e077 2023-10-30 14:54:51,809 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231030652fa08d7eaa489aa53112a25e4c6e52 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231030652fa08d7eaa489aa53112a25e4c6e52 2023-10-30 14:54:51,809 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 14:54:51,809 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030' 2023-10-30 14:54:51,809 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 14:54:52,156 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030cc715fa4aeb64b24acfc816e74b68ce3 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030cc715fa4aeb64b24acfc816e74b68ce3 2023-10-30 14:54:52,157 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310303833da15e0854fa286dc5ac210dd1201 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310303833da15e0854fa286dc5ac210dd1201 2023-10-30 14:54:52,157 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 14:54:52,158 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 14:54:52,186 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/54b2bd630a144313b87f0cfe557a0624 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-10-30 14:54:52,188 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/54b2bd630a144313b87f0cfe557a0624}] 2023-10-30 14:54:52,190 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/54b2bd630a144313b87f0cfe557a0624 for inclusion in 177e982e175e289e7a05a97bd09698ab/family1 2023-10-30 14:54:52,191 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/75ed923305b44fffa8b7b8f860753945 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-10-30 14:54:52,192 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=32 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/75ed923305b44fffa8b7b8f860753945}] 2023-10-30 14:54:52,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/75ed923305b44fffa8b7b8f860753945 for inclusion in ae1fa8048a3a8e4b39683c8300846593/family1 2023-10-30 14:54:52,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-10-30 14:54:52,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-30 14:54:52,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 177e982e175e289e7a05a97bd09698ab: 2023-10-30 14:54:52,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/54b2bd630a144313b87f0cfe557a0624 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__2av124poqo1j3fcgr1t0ip5r6aarauf3sv9fafl6cqefenc4jgldgbpsefrmktnm/family1/54b2bd630a144313b87f0cfe557a0624 2023-10-30 14:54:52,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-10-30 14:54:52,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last=1 2023-10-30 14:54:52,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for ae1fa8048a3a8e4b39683c8300846593: 2023-10-30 14:54:52,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__2av124poqo1j3fcgr1t0ip5r6aarauf3sv9fafl6cqefenc4jgldgbpsefrmktnm/family1/54b2bd630a144313b87f0cfe557a0624 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/de26c923e5044546ba259400565682eb_SeqId_34_ 2023-10-30 14:54:52,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/75ed923305b44fffa8b7b8f860753945 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__s3ooodo3l58pietsok88b5u175fbn5jil6l744k1np65hl3knh9hv771p8fejpab/family1/75ed923305b44fffa8b7b8f860753945 2023-10-30 14:54:52,199 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__2av124poqo1j3fcgr1t0ip5r6aarauf3sv9fafl6cqefenc4jgldgbpsefrmktnm/family1/54b2bd630a144313b87f0cfe557a0624 into 177e982e175e289e7a05a97bd09698ab/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/de26c923e5044546ba259400565682eb_SeqId_34_ - updating store file list. 2023-10-30 14:54:52,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__s3ooodo3l58pietsok88b5u175fbn5jil6l744k1np65hl3knh9hv771p8fejpab/family1/75ed923305b44fffa8b7b8f860753945 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/30b832d1e75f44b38927f55f1514eb84_SeqId_34_ 2023-10-30 14:54:52,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__s3ooodo3l58pietsok88b5u175fbn5jil6l744k1np65hl3knh9hv771p8fejpab/family1/75ed923305b44fffa8b7b8f860753945 into ae1fa8048a3a8e4b39683c8300846593/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/30b832d1e75f44b38927f55f1514eb84_SeqId_34_ - updating store file list. 2023-10-30 14:54:52,202 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/de26c923e5044546ba259400565682eb_SeqId_34_ into 177e982e175e289e7a05a97bd09698ab/family1 2023-10-30 14:54:52,203 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__2av124poqo1j3fcgr1t0ip5r6aarauf3sv9fafl6cqefenc4jgldgbpsefrmktnm/family1/54b2bd630a144313b87f0cfe557a0624 into 177e982e175e289e7a05a97bd09698ab/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/de26c923e5044546ba259400565682eb_SeqId_34_) 2023-10-30 14:54:52,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__2av124poqo1j3fcgr1t0ip5r6aarauf3sv9fafl6cqefenc4jgldgbpsefrmktnm/family1/54b2bd630a144313b87f0cfe557a0624 2023-10-30 14:54:52,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:54:52,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/30b832d1e75f44b38927f55f1514eb84_SeqId_34_ into ae1fa8048a3a8e4b39683c8300846593/family1 2023-10-30 14:54:52,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__s3ooodo3l58pietsok88b5u175fbn5jil6l744k1np65hl3knh9hv771p8fejpab/family1/75ed923305b44fffa8b7b8f860753945 into ae1fa8048a3a8e4b39683c8300846593/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/30b832d1e75f44b38927f55f1514eb84_SeqId_34_) 2023-10-30 14:54:52,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testCompactionWithHFileLink__s3ooodo3l58pietsok88b5u175fbn5jil6l744k1np65hl3knh9hv771p8fejpab/family1/75ed923305b44fffa8b7b8f860753945 2023-10-30 14:54:52,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-10-30 14:54:52,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(1912): 177e982e175e289e7a05a97bd09698ab/family1 is initiating minor compaction (all files) 2023-10-30 14:54:52,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@57d1ee8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-10-30 14:54:52,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:54:52,207 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 14:54:52,207 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:52,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-10-30 14:54:52,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(1912): ae1fa8048a3a8e4b39683c8300846593/family1 is initiating minor compaction (all files) 2023-10-30 14:54:52,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@404c9255; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-10-30 14:54:52,209 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023103064f18b070bd6417b970ba5bf25812d1b to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023103064f18b070bd6417b970ba5bf25812d1b 2023-10-30 14:54:52,209 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 14:54:52,210 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231030ad4c64c2896f4546ba4520b49f1c1bfe to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231030ad4c64c2896f4546ba4520b49f1c1bfe 2023-10-30 14:54:52,210 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:52,210 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231030d85f81458f234c52accfe89b5cc77d13 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231030d85f81458f234c52accfe89b5cc77d13 2023-10-30 14:54:52,211 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202310301d84ee4c3d9b4d14a880aaa505aaffa5 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202310301d84ee4c3d9b4d14a880aaa505aaffa5 2023-10-30 14:54:52,211 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231030f6643351702042038f9dd4acd6531b12 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231030f6643351702042038f9dd4acd6531b12 2023-10-30 14:54:52,211 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 14:54:52,211 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030' 2023-10-30 14:54:52,212 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 14:54:52,212 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202310306b07bd1b692b4ae08c74af088fe0fb4c to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202310306b07bd1b692b4ae08c74af088fe0fb4c 2023-10-30 14:54:52,212 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023103081d39d6093c24c6089bddb6c87ad0027 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023103081d39d6093c24c6089bddb6c87ad0027 2023-10-30 14:54:52,213 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231030d4476e19c8584a6ba1a6034376399e72 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231030d4476e19c8584a6ba1a6034376399e72 2023-10-30 14:54:52,213 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 14:54:52,213 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030' 2023-10-30 14:54:52,213 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 14:54:52,213 INFO [Listener at localhost/34621] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-10-30 14:54:52,215 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:54:52,218 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:54:52,221 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:54:52,222 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:54:52,228 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:54:52,229 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:54:52,247 INFO [Listener at localhost/34621] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=294 (was 246) - Thread LEAK? -, OpenFileDescriptor=776 (was 626) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 310), ProcessCount=168 (was 168), AvailableMemoryMB=1531 (was 1654) 2023-10-30 14:54:52,260 INFO [Listener at localhost/34621] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=294, OpenFileDescriptor=776, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=168, AvailableMemoryMB=1530 2023-10-30 14:54:52,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$15(3014): Client=jenkins//148.251.75.209 creating {NAME => 'ns'} 2023-10-30 14:54:52,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-10-30 14:54:52,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-30 14:54:52,275 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-30 14:54:52,276 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family1/320c086816f34e9794dd9f04ed14cb92 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/320c086816f34e9794dd9f04ed14cb92 2023-10-30 14:54:52,278 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 10 msec 2023-10-30 14:54:52,281 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-10-30 14:54:52,281 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in bb4420255160505884d9c82dfe0aed2b/family1 of bb4420255160505884d9c82dfe0aed2b into 320c086816f34e9794dd9f04ed14cb92(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:54:52,281 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for bb4420255160505884d9c82dfe0aed2b: 2023-10-30 14:54:52,281 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b., storeName=bb4420255160505884d9c82dfe0aed2b/family1, priority=12, startTime=1698677691398; duration=0sec 2023-10-30 14:54:52,281 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-10-30 14:54:52,282 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 177e982e175e289e7a05a97bd09698ab/family1 in testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:52,282 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-2b47a1baeecd4aa1ad0a3c96868a7d18, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-aa621a482a484c03adc30abe5de75ad6, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-ab92fff50dab4ae2982dd62a74c7a087, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-ad30394daddd43ab8c1062194de0e1e9, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/de26c923e5044546ba259400565682eb_SeqId_34_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp, totalSize=28.9 K 2023-10-30 14:54:52,282 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-2b47a1baeecd4aa1ad0a3c96868a7d18, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677668183 2023-10-30 14:54:52,283 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-aa621a482a484c03adc30abe5de75ad6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677670013 2023-10-30 14:54:52,283 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-ab92fff50dab4ae2982dd62a74c7a087, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677671839 2023-10-30 14:54:52,283 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-ad30394daddd43ab8c1062194de0e1e9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677673772 2023-10-30 14:54:52,284 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting de26c923e5044546ba259400565682eb_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1698677668183 2023-10-30 14:54:52,294 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] throttle.PressureAwareThroughputController(145): 177e982e175e289e7a05a97bd09698ab#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:54:52,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-759e3982aa854502a1ce7acd8e912e27, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-ea958de57c9f4ab68aced0e68b1dc78e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-f74278cae04e42c2964dcd29438480ca, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-cb4f7beb9e6145b69a78a38546bb4fc5] to archive 2023-10-30 14:54:52,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:52,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-759e3982aa854502a1ce7acd8e912e27 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-759e3982aa854502a1ce7acd8e912e27 2023-10-30 14:54:52,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-ea958de57c9f4ab68aced0e68b1dc78e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-ea958de57c9f4ab68aced0e68b1dc78e 2023-10-30 14:54:52,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-f74278cae04e42c2964dcd29438480ca to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-f74278cae04e42c2964dcd29438480ca 2023-10-30 14:54:52,313 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-cb4f7beb9e6145b69a78a38546bb4fc5 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family1/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-cb4f7beb9e6145b69a78a38546bb4fc5 2023-10-30 14:54:52,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-30 14:54:52,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-30 14:54:52,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-10-30 14:54:52,383 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 14:54:52,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-10-30 14:54:52,384 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 14:54:52,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 14:54:52,388 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c 2023-10-30 14:54:52,388 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f 2023-10-30 14:54:52,389 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330 2023-10-30 14:54:52,389 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c empty. 2023-10-30 14:54:52,389 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330 empty. 2023-10-30 14:54:52,390 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f empty. 2023-10-30 14:54:52,390 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c 2023-10-30 14:54:52,390 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330 2023-10-30 14:54:52,391 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f 2023-10-30 14:54:52,391 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-10-30 14:54:52,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 14:54:52,684 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/.tmp/family2/0e709b1a1f7344249bf5370595f8ab97 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/0e709b1a1f7344249bf5370595f8ab97 2023-10-30 14:54:52,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 14:54:52,694 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in bb4420255160505884d9c82dfe0aed2b/family2 of bb4420255160505884d9c82dfe0aed2b into 0e709b1a1f7344249bf5370595f8ab97(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:54:52,694 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for bb4420255160505884d9c82dfe0aed2b: 2023-10-30 14:54:52,694 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b., storeName=bb4420255160505884d9c82dfe0aed2b/family2, priority=12, startTime=1698677691399; duration=1sec 2023-10-30 14:54:52,695 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-10-30 14:54:52,695 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HRegion(2259): Starting compaction of ae1fa8048a3a8e4b39683c8300846593/family1 in testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:52,695 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-295e1e182a8645f2b8e4c0bbbd048585, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-b598326d3877443f8a5c2ce183ba1ced, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-4808a5156fa94e7fae3d06858c38b36e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-de1b296614cb4a1fbc6d3967bac55140, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/30b832d1e75f44b38927f55f1514eb84_SeqId_34_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp, totalSize=28.9 K 2023-10-30 14:54:52,696 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-295e1e182a8645f2b8e4c0bbbd048585, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677668182 2023-10-30 14:54:52,697 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-b598326d3877443f8a5c2ce183ba1ced, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677670012 2023-10-30 14:54:52,699 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-4808a5156fa94e7fae3d06858c38b36e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677671838 2023-10-30 14:54:52,700 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-de1b296614cb4a1fbc6d3967bac55140, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677673771 2023-10-30 14:54:52,700 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting 30b832d1e75f44b38927f55f1514eb84_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1698677668182 2023-10-30 14:54:52,714 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-581a155e7d464babbdeafdaab27919b1, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-401ae32ee6274f79bd17dc7a11d6b617, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-deff8397ffde4b2480faeb0b70f4f9c3, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-a71b6279cb934faf9d40886373be5d6d] to archive 2023-10-30 14:54:52,714 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:52,718 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-581a155e7d464babbdeafdaab27919b1 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-581a155e7d464babbdeafdaab27919b1 2023-10-30 14:54:52,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-401ae32ee6274f79bd17dc7a11d6b617 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-401ae32ee6274f79bd17dc7a11d6b617 2023-10-30 14:54:52,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-deff8397ffde4b2480faeb0b70f4f9c3 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-deff8397ffde4b2480faeb0b70f4f9c3 2023-10-30 14:54:52,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-a71b6279cb934faf9d40886373be5d6d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/family2/testCompactionWithHFileLink=bb4420255160505884d9c82dfe0aed2b-a71b6279cb934faf9d40886373be5d6d 2023-10-30 14:54:52,727 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] throttle.PressureAwareThroughputController(145): ae1fa8048a3a8e4b39683c8300846593#family1#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:54:52,804 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-10-30 14:54:52,806 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => bb974e53dc6d462888c86a0e83d2293c, NAME => 'ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:54:52,806 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 953b179baa5064d7c5b98a46f266b330, NAME => 'ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:54:52,807 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => ab337776724960eefa44070b970f617f, NAME => 'ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:54:52,816 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:52,816 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing bb974e53dc6d462888c86a0e83d2293c, disabling compactions & flushes 2023-10-30 14:54:52,816 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:54:52,816 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:54:52,816 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. after waiting 0 ms 2023-10-30 14:54:52,816 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:54:52,816 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:54:52,816 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for bb974e53dc6d462888c86a0e83d2293c: 2023-10-30 14:54:52,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 14:54:53,123 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family1/b8a3f8c60a5d446a8dc3ef0ff44b29e3 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/b8a3f8c60a5d446a8dc3ef0ff44b29e3 2023-10-30 14:54:53,130 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 177e982e175e289e7a05a97bd09698ab/family1 of 177e982e175e289e7a05a97bd09698ab into b8a3f8c60a5d446a8dc3ef0ff44b29e3(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:54:53,130 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 177e982e175e289e7a05a97bd09698ab: 2023-10-30 14:54:53,130 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1698677692205; duration=0sec 2023-10-30 14:54:53,130 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-10-30 14:54:53,130 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-30 14:54:53,132 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-30 14:54:53,132 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1912): 177e982e175e289e7a05a97bd09698ab/family2 is initiating minor compaction (all files) 2023-10-30 14:54:53,132 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 177e982e175e289e7a05a97bd09698ab/family2 in testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:54:53,132 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-53bcf2454ffe4417923cc96b7a80572d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-54b63ff7f107495b9b03d1485db0e3c4, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-842819db31bd40db9555b648b51e83e3, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-49944bc1a53c4289b0eb4d14a1ba38a7] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp, totalSize=20.4 K 2023-10-30 14:54:53,133 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-53bcf2454ffe4417923cc96b7a80572d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677668183 2023-10-30 14:54:53,133 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-54b63ff7f107495b9b03d1485db0e3c4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677670013 2023-10-30 14:54:53,134 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-842819db31bd40db9555b648b51e83e3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677671839 2023-10-30 14:54:53,134 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-49944bc1a53c4289b0eb4d14a1ba38a7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677673772 2023-10-30 14:54:53,146 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] throttle.PressureAwareThroughputController(145): 177e982e175e289e7a05a97bd09698ab#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:54:53,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-2b47a1baeecd4aa1ad0a3c96868a7d18, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-aa621a482a484c03adc30abe5de75ad6, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-ab92fff50dab4ae2982dd62a74c7a087, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-ad30394daddd43ab8c1062194de0e1e9, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/de26c923e5044546ba259400565682eb_SeqId_34_] to archive 2023-10-30 14:54:53,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:53,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-2b47a1baeecd4aa1ad0a3c96868a7d18 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-2b47a1baeecd4aa1ad0a3c96868a7d18 2023-10-30 14:54:53,213 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-aa621a482a484c03adc30abe5de75ad6 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-aa621a482a484c03adc30abe5de75ad6 2023-10-30 14:54:53,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-ab92fff50dab4ae2982dd62a74c7a087 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-ab92fff50dab4ae2982dd62a74c7a087 2023-10-30 14:54:53,215 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:53,215 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 953b179baa5064d7c5b98a46f266b330, disabling compactions & flushes 2023-10-30 14:54:53,215 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:54:53,215 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:54:53,215 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:53,216 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. after waiting 0 ms 2023-10-30 14:54:53,216 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing ab337776724960eefa44070b970f617f, disabling compactions & flushes 2023-10-30 14:54:53,216 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:54:53,216 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:54:53,216 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:54:53,216 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:54:53,216 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-ad30394daddd43ab8c1062194de0e1e9 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-ad30394daddd43ab8c1062194de0e1e9 2023-10-30 14:54:53,216 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. after waiting 0 ms 2023-10-30 14:54:53,216 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 953b179baa5064d7c5b98a46f266b330: 2023-10-30 14:54:53,216 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:54:53,217 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:54:53,217 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for ab337776724960eefa44070b970f617f: 2023-10-30 14:54:53,218 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/de26c923e5044546ba259400565682eb_SeqId_34_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family1/de26c923e5044546ba259400565682eb_SeqId_34_ 2023-10-30 14:54:53,220 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 14:54:53,221 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698677693221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677693221"}]},"ts":"1698677693221"} 2023-10-30 14:54:53,221 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698677693221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677693221"}]},"ts":"1698677693221"} 2023-10-30 14:54:53,221 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698677693221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677693221"}]},"ts":"1698677693221"} 2023-10-30 14:54:53,224 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-30 14:54:53,225 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 14:54:53,225 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677693225"}]},"ts":"1698677693225"} 2023-10-30 14:54:53,226 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-10-30 14:54:53,229 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bb974e53dc6d462888c86a0e83d2293c, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ab337776724960eefa44070b970f617f, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=953b179baa5064d7c5b98a46f266b330, ASSIGN}] 2023-10-30 14:54:53,230 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=953b179baa5064d7c5b98a46f266b330, ASSIGN 2023-10-30 14:54:53,230 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ab337776724960eefa44070b970f617f, ASSIGN 2023-10-30 14:54:53,231 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bb974e53dc6d462888c86a0e83d2293c, ASSIGN 2023-10-30 14:54:53,231 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=953b179baa5064d7c5b98a46f266b330, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:54:53,231 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ab337776724960eefa44070b970f617f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:54:53,231 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bb974e53dc6d462888c86a0e83d2293c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:54:53,384 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=bb974e53dc6d462888c86a0e83d2293c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:53,384 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=953b179baa5064d7c5b98a46f266b330, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:53,384 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=ab337776724960eefa44070b970f617f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:53,385 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698677693384"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677693384"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677693384"}]},"ts":"1698677693384"} 2023-10-30 14:54:53,385 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698677693384"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677693384"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677693384"}]},"ts":"1698677693384"} 2023-10-30 14:54:53,385 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698677693384"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677693384"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677693384"}]},"ts":"1698677693384"} 2023-10-30 14:54:53,386 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure bb974e53dc6d462888c86a0e83d2293c, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:53,387 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=107, state=RUNNABLE; OpenRegionProcedure ab337776724960eefa44070b970f617f, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:53,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure 953b179baa5064d7c5b98a46f266b330, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:54:53,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 14:54:53,539 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:53,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:54:53,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ab337776724960eefa44070b970f617f, NAME => 'ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f.', STARTKEY => '1', ENDKEY => '2'} 2023-10-30 14:54:53,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction ab337776724960eefa44070b970f617f 2023-10-30 14:54:53,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:53,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ab337776724960eefa44070b970f617f 2023-10-30 14:54:53,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ab337776724960eefa44070b970f617f 2023-10-30 14:54:53,544 INFO [StoreOpener-ab337776724960eefa44070b970f617f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ab337776724960eefa44070b970f617f 2023-10-30 14:54:53,546 DEBUG [StoreOpener-ab337776724960eefa44070b970f617f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1 2023-10-30 14:54:53,546 DEBUG [StoreOpener-ab337776724960eefa44070b970f617f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1 2023-10-30 14:54:53,546 INFO [StoreOpener-ab337776724960eefa44070b970f617f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab337776724960eefa44070b970f617f columnFamilyName family1 2023-10-30 14:54:53,548 INFO [StoreOpener-ab337776724960eefa44070b970f617f-1] regionserver.HStore(310): Store=ab337776724960eefa44070b970f617f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:53,548 INFO [StoreOpener-ab337776724960eefa44070b970f617f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ab337776724960eefa44070b970f617f 2023-10-30 14:54:53,550 DEBUG [StoreOpener-ab337776724960eefa44070b970f617f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2 2023-10-30 14:54:53,550 DEBUG [StoreOpener-ab337776724960eefa44070b970f617f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2 2023-10-30 14:54:53,550 INFO [StoreOpener-ab337776724960eefa44070b970f617f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab337776724960eefa44070b970f617f columnFamilyName family2 2023-10-30 14:54:53,552 INFO [StoreOpener-ab337776724960eefa44070b970f617f-1] regionserver.HStore(310): Store=ab337776724960eefa44070b970f617f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:53,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f 2023-10-30 14:54:53,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f 2023-10-30 14:54:53,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 14:54:53,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ab337776724960eefa44070b970f617f 2023-10-30 14:54:53,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:54:53,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ab337776724960eefa44070b970f617f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73257154, jitterRate=0.0916166603565216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 14:54:53,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ab337776724960eefa44070b970f617f: 2023-10-30 14:54:53,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f., pid=110, masterSystemTime=1698677693539 2023-10-30 14:54:53,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:54:53,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:54:53,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:54:53,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb974e53dc6d462888c86a0e83d2293c, NAME => 'ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c.', STARTKEY => '', ENDKEY => '1'} 2023-10-30 14:54:53,563 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=ab337776724960eefa44070b970f617f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:53,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction bb974e53dc6d462888c86a0e83d2293c 2023-10-30 14:54:53,564 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698677693563"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677693563"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677693563"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677693563"}]},"ts":"1698677693563"} 2023-10-30 14:54:53,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:53,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for bb974e53dc6d462888c86a0e83d2293c 2023-10-30 14:54:53,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for bb974e53dc6d462888c86a0e83d2293c 2023-10-30 14:54:53,565 INFO [StoreOpener-bb974e53dc6d462888c86a0e83d2293c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bb974e53dc6d462888c86a0e83d2293c 2023-10-30 14:54:53,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=107 2023-10-30 14:54:53,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=107, state=SUCCESS; OpenRegionProcedure ab337776724960eefa44070b970f617f, server=jenkins-hbase20.apache.org,36359,1698677568317 in 178 msec 2023-10-30 14:54:53,567 DEBUG [StoreOpener-bb974e53dc6d462888c86a0e83d2293c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1 2023-10-30 14:54:53,567 DEBUG [StoreOpener-bb974e53dc6d462888c86a0e83d2293c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1 2023-10-30 14:54:53,567 INFO [StoreOpener-bb974e53dc6d462888c86a0e83d2293c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb974e53dc6d462888c86a0e83d2293c columnFamilyName family1 2023-10-30 14:54:53,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ab337776724960eefa44070b970f617f, ASSIGN in 338 msec 2023-10-30 14:54:53,568 INFO [StoreOpener-bb974e53dc6d462888c86a0e83d2293c-1] regionserver.HStore(310): Store=bb974e53dc6d462888c86a0e83d2293c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:53,569 INFO [StoreOpener-bb974e53dc6d462888c86a0e83d2293c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region bb974e53dc6d462888c86a0e83d2293c 2023-10-30 14:54:53,570 DEBUG [StoreOpener-bb974e53dc6d462888c86a0e83d2293c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2 2023-10-30 14:54:53,570 DEBUG [StoreOpener-bb974e53dc6d462888c86a0e83d2293c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2 2023-10-30 14:54:53,571 INFO [StoreOpener-bb974e53dc6d462888c86a0e83d2293c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb974e53dc6d462888c86a0e83d2293c columnFamilyName family2 2023-10-30 14:54:53,572 INFO [StoreOpener-bb974e53dc6d462888c86a0e83d2293c-1] regionserver.HStore(310): Store=bb974e53dc6d462888c86a0e83d2293c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:53,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c 2023-10-30 14:54:53,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c 2023-10-30 14:54:53,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 14:54:53,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for bb974e53dc6d462888c86a0e83d2293c 2023-10-30 14:54:53,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:54:53,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened bb974e53dc6d462888c86a0e83d2293c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74789920, jitterRate=0.1144566535949707}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 14:54:53,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for bb974e53dc6d462888c86a0e83d2293c: 2023-10-30 14:54:53,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c., pid=109, masterSystemTime=1698677693539 2023-10-30 14:54:53,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:54:53,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:54:53,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:54:53,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 953b179baa5064d7c5b98a46f266b330, NAME => 'ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330.', STARTKEY => '2', ENDKEY => ''} 2023-10-30 14:54:53,583 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=bb974e53dc6d462888c86a0e83d2293c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:53,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 953b179baa5064d7c5b98a46f266b330 2023-10-30 14:54:53,583 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698677693583"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677693583"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677693583"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677693583"}]},"ts":"1698677693583"} 2023-10-30 14:54:53,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:54:53,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 953b179baa5064d7c5b98a46f266b330 2023-10-30 14:54:53,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 953b179baa5064d7c5b98a46f266b330 2023-10-30 14:54:53,585 INFO [StoreOpener-953b179baa5064d7c5b98a46f266b330-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 953b179baa5064d7c5b98a46f266b330 2023-10-30 14:54:53,587 DEBUG [StoreOpener-953b179baa5064d7c5b98a46f266b330-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1 2023-10-30 14:54:53,587 DEBUG [StoreOpener-953b179baa5064d7c5b98a46f266b330-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1 2023-10-30 14:54:53,587 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-10-30 14:54:53,588 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure bb974e53dc6d462888c86a0e83d2293c, server=jenkins-hbase20.apache.org,36359,1698677568317 in 199 msec 2023-10-30 14:54:53,588 INFO [StoreOpener-953b179baa5064d7c5b98a46f266b330-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 953b179baa5064d7c5b98a46f266b330 columnFamilyName family1 2023-10-30 14:54:53,589 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bb974e53dc6d462888c86a0e83d2293c, ASSIGN in 359 msec 2023-10-30 14:54:53,589 INFO [StoreOpener-953b179baa5064d7c5b98a46f266b330-1] regionserver.HStore(310): Store=953b179baa5064d7c5b98a46f266b330/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:53,590 INFO [StoreOpener-953b179baa5064d7c5b98a46f266b330-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 953b179baa5064d7c5b98a46f266b330 2023-10-30 14:54:53,590 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 14:54:53,591 DEBUG [StoreOpener-953b179baa5064d7c5b98a46f266b330-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2 2023-10-30 14:54:53,591 DEBUG [StoreOpener-953b179baa5064d7c5b98a46f266b330-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2 2023-10-30 14:54:53,592 INFO [StoreOpener-953b179baa5064d7c5b98a46f266b330-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 953b179baa5064d7c5b98a46f266b330 columnFamilyName family2 2023-10-30 14:54:53,593 INFO [StoreOpener-953b179baa5064d7c5b98a46f266b330-1] regionserver.HStore(310): Store=953b179baa5064d7c5b98a46f266b330/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:54:53,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330 2023-10-30 14:54:53,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330 2023-10-30 14:54:53,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 14:54:53,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 953b179baa5064d7c5b98a46f266b330 2023-10-30 14:54:53,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:54:53,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 953b179baa5064d7c5b98a46f266b330; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58852310, jitterRate=-0.12303224205970764}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 14:54:53,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 953b179baa5064d7c5b98a46f266b330: 2023-10-30 14:54:53,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330., pid=111, masterSystemTime=1698677693539 2023-10-30 14:54:53,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:54:53,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:54:53,602 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=953b179baa5064d7c5b98a46f266b330, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:53,602 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698677693602"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677693602"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677693602"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677693602"}]},"ts":"1698677693602"} 2023-10-30 14:54:53,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=108 2023-10-30 14:54:53,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure 953b179baa5064d7c5b98a46f266b330, server=jenkins-hbase20.apache.org,36359,1698677568317 in 215 msec 2023-10-30 14:54:53,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=105 2023-10-30 14:54:53,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=953b179baa5064d7c5b98a46f266b330, ASSIGN in 375 msec 2023-10-30 14:54:53,606 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 14:54:53,606 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677693606"}]},"ts":"1698677693606"} 2023-10-30 14:54:53,607 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-10-30 14:54:53,608 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 14:54:53,609 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2290 sec 2023-10-30 14:54:53,947 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family1/5db4145aa4a24618b74b5bfcbda91e5c as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/5db4145aa4a24618b74b5bfcbda91e5c 2023-10-30 14:54:53,952 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in ae1fa8048a3a8e4b39683c8300846593/family1 of ae1fa8048a3a8e4b39683c8300846593 into 5db4145aa4a24618b74b5bfcbda91e5c(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:54:53,952 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for ae1fa8048a3a8e4b39683c8300846593: 2023-10-30 14:54:53,952 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1698677692208; duration=1sec 2023-10-30 14:54:53,953 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-10-30 14:54:53,953 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-30 14:54:53,955 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-30 14:54:53,955 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HStore(1912): ae1fa8048a3a8e4b39683c8300846593/family2 is initiating minor compaction (all files) 2023-10-30 14:54:53,955 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HRegion(2259): Starting compaction of ae1fa8048a3a8e4b39683c8300846593/family2 in testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:54:53,955 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-a894379bbf574430a9752a8e8fe13ea4, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-32bfccbe5e7f4ffa98cc1d1b8f0aa0d5, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-2585357f0708418eb01e1e185092d495, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-a37fba37977a400b9a368a162f1a8993] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp, totalSize=20.4 K 2023-10-30 14:54:53,956 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-a894379bbf574430a9752a8e8fe13ea4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677668182 2023-10-30 14:54:53,956 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-32bfccbe5e7f4ffa98cc1d1b8f0aa0d5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677670012 2023-10-30 14:54:53,957 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-2585357f0708418eb01e1e185092d495, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677671838 2023-10-30 14:54:53,958 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-a37fba37977a400b9a368a162f1a8993, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677673771 2023-10-30 14:54:53,968 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] throttle.PressureAwareThroughputController(145): ae1fa8048a3a8e4b39683c8300846593#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:54:54,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-295e1e182a8645f2b8e4c0bbbd048585, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-b598326d3877443f8a5c2ce183ba1ced, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-4808a5156fa94e7fae3d06858c38b36e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-de1b296614cb4a1fbc6d3967bac55140, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/30b832d1e75f44b38927f55f1514eb84_SeqId_34_] to archive 2023-10-30 14:54:54,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:54,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-295e1e182a8645f2b8e4c0bbbd048585 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-295e1e182a8645f2b8e4c0bbbd048585 2023-10-30 14:54:54,011 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-b598326d3877443f8a5c2ce183ba1ced to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-b598326d3877443f8a5c2ce183ba1ced 2023-10-30 14:54:54,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-4808a5156fa94e7fae3d06858c38b36e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-4808a5156fa94e7fae3d06858c38b36e 2023-10-30 14:54:54,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-de1b296614cb4a1fbc6d3967bac55140 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-de1b296614cb4a1fbc6d3967bac55140 2023-10-30 14:54:54,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/30b832d1e75f44b38927f55f1514eb84_SeqId_34_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family1/30b832d1e75f44b38927f55f1514eb84_SeqId_34_ 2023-10-30 14:54:54,372 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/.tmp/family2/7d09a4bdca734fa6954828c922c79e9b as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/7d09a4bdca734fa6954828c922c79e9b 2023-10-30 14:54:54,380 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 177e982e175e289e7a05a97bd09698ab/family2 of 177e982e175e289e7a05a97bd09698ab into 7d09a4bdca734fa6954828c922c79e9b(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:54:54,380 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 177e982e175e289e7a05a97bd09698ab: 2023-10-30 14:54:54,380 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab., storeName=177e982e175e289e7a05a97bd09698ab/family2, priority=12, startTime=1698677691495; duration=1sec 2023-10-30 14:54:54,380 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-10-30 14:54:54,380 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-10-30 14:54:54,381 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-30 14:54:54,381 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-30 14:54:54,381 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. because compaction request was cancelled 2023-10-30 14:54:54,381 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-10-30 14:54:54,382 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-30 14:54:54,382 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-30 14:54:54,382 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. because compaction request was cancelled 2023-10-30 14:54:54,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-53bcf2454ffe4417923cc96b7a80572d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-54b63ff7f107495b9b03d1485db0e3c4, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-842819db31bd40db9555b648b51e83e3, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-49944bc1a53c4289b0eb4d14a1ba38a7] to archive 2023-10-30 14:54:54,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:54,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-53bcf2454ffe4417923cc96b7a80572d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-53bcf2454ffe4417923cc96b7a80572d 2023-10-30 14:54:54,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-54b63ff7f107495b9b03d1485db0e3c4 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-54b63ff7f107495b9b03d1485db0e3c4 2023-10-30 14:54:54,409 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-842819db31bd40db9555b648b51e83e3 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-842819db31bd40db9555b648b51e83e3 2023-10-30 14:54:54,410 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-49944bc1a53c4289b0eb4d14a1ba38a7 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/family2/testCompactionWithHFileLink=177e982e175e289e7a05a97bd09698ab-49944bc1a53c4289b0eb4d14a1ba38a7 2023-10-30 14:54:54,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 14:54:54,495 INFO [Listener at localhost/34621] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-10-30 14:54:54,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:54,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:54,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:54,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:54,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-30 14:54:54,504 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-30 14:54:54,504 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:54,504 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-30 14:54:54,504 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-30 14:54:54,504 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:54,504 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:54,505 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:54,505 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:54,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:54,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:54,506 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:54,506 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:54,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:54,506 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-30 14:54:54,507 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-30 14:54:54,507 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-30 14:54:54,507 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:54,507 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-30 14:54:54,507 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:54:54,507 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. started... 2023-10-30 14:54:54,507 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 14:54:54,507 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:54,507 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:54:54,508 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 953b179baa5064d7c5b98a46f266b330 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 14:54:54,508 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. started... 2023-10-30 14:54:54,507 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:54:54,509 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ab337776724960eefa44070b970f617f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 14:54:54,509 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. started... 2023-10-30 14:54:54,509 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bb974e53dc6d462888c86a0e83d2293c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 14:54:54,922 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030466b1476d41b47bf99e6b3ab0b2e6dd2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231030466b1476d41b47bf99e6b3ab0b2e6dd2 2023-10-30 14:54:54,922 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310307f754d4658ae4842b6a04952bcb6697d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310307f754d4658ae4842b6a04952bcb6697d 2023-10-30 14:54:54,922 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103061eb8c810f3d4bb391279c5348cec233 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023103061eb8c810f3d4bb391279c5348cec233 2023-10-30 14:54:55,203 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/.tmp/family2/06db01d02345420eab7aafeb81eecff0 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/06db01d02345420eab7aafeb81eecff0 2023-10-30 14:54:55,210 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in ae1fa8048a3a8e4b39683c8300846593/family2 of ae1fa8048a3a8e4b39683c8300846593 into 06db01d02345420eab7aafeb81eecff0(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:54:55,210 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for ae1fa8048a3a8e4b39683c8300846593: 2023-10-30 14:54:55,210 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593., storeName=ae1fa8048a3a8e4b39683c8300846593/family2, priority=12, startTime=1698677691565; duration=1sec 2023-10-30 14:54:55,210 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:54:55,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-a894379bbf574430a9752a8e8fe13ea4, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-32bfccbe5e7f4ffa98cc1d1b8f0aa0d5, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-2585357f0708418eb01e1e185092d495, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-a37fba37977a400b9a368a162f1a8993] to archive 2023-10-30 14:54:55,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:54:55,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-a894379bbf574430a9752a8e8fe13ea4 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-a894379bbf574430a9752a8e8fe13ea4 2023-10-30 14:54:55,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-32bfccbe5e7f4ffa98cc1d1b8f0aa0d5 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-32bfccbe5e7f4ffa98cc1d1b8f0aa0d5 2023-10-30 14:54:55,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-2585357f0708418eb01e1e185092d495 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-2585357f0708418eb01e1e185092d495 2023-10-30 14:54:55,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-a37fba37977a400b9a368a162f1a8993 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/family2/testCompactionWithHFileLink=ae1fa8048a3a8e4b39683c8300846593-a37fba37977a400b9a368a162f1a8993 2023-10-30 14:54:55,329 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family1/a34016349384441eb18143d45412ef49 2023-10-30 14:54:55,331 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family1/5a0f4e56b4f342289372fae9f8dedde6 2023-10-30 14:54:55,331 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family1/d0a9babe230146abad63ece78a4a8d7a 2023-10-30 14:54:55,754 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310301c452dd1bb064f658b608f6fbc64c643 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202310301c452dd1bb064f658b608f6fbc64c643 2023-10-30 14:54:55,754 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103017557c90907d47e6bea194294d922f4b to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023103017557c90907d47e6bea194294d922f4b 2023-10-30 14:54:55,754 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310306e30ccf6ee304b3b91c024450096b289 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202310306e30ccf6ee304b3b91c024450096b289 2023-10-30 14:54:56,169 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family2/b2f6cebbaef94604b9a93f6673471afd 2023-10-30 14:54:56,169 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family2/a90fc83357fe488c9d45a6e48c614368 2023-10-30 14:54:56,173 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family1/5a0f4e56b4f342289372fae9f8dedde6 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/5a0f4e56b4f342289372fae9f8dedde6 2023-10-30 14:54:56,174 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family1/d0a9babe230146abad63ece78a4a8d7a as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/d0a9babe230146abad63ece78a4a8d7a 2023-10-30 14:54:56,177 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family2/f6ce72f8c9124493822a8274400c352e 2023-10-30 14:54:56,178 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/5a0f4e56b4f342289372fae9f8dedde6, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 14:54:56,180 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family2/b2f6cebbaef94604b9a93f6673471afd as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/b2f6cebbaef94604b9a93f6673471afd 2023-10-30 14:54:56,181 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/d0a9babe230146abad63ece78a4a8d7a, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 14:54:56,181 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family1/a34016349384441eb18143d45412ef49 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/a34016349384441eb18143d45412ef49 2023-10-30 14:54:56,181 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family2/a90fc83357fe488c9d45a6e48c614368 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/a90fc83357fe488c9d45a6e48c614368 2023-10-30 14:54:56,185 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/a34016349384441eb18143d45412ef49, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 14:54:56,185 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/a90fc83357fe488c9d45a6e48c614368, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 14:54:56,185 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/b2f6cebbaef94604b9a93f6673471afd, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 14:54:56,186 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 953b179baa5064d7c5b98a46f266b330 in 1678ms, sequenceid=5, compaction requested=false 2023-10-30 14:54:56,186 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ab337776724960eefa44070b970f617f in 1677ms, sequenceid=5, compaction requested=false 2023-10-30 14:54:56,186 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-10-30 14:54:56,186 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-10-30 14:54:56,187 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family2/f6ce72f8c9124493822a8274400c352e as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/f6ce72f8c9124493822a8274400c352e 2023-10-30 14:54:56,187 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 953b179baa5064d7c5b98a46f266b330: 2023-10-30 14:54:56,187 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:54:56,188 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 14:54:56,188 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ab337776724960eefa44070b970f617f: 2023-10-30 14:54:56,188 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:54:56,188 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 14:54:56,192 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/f6ce72f8c9124493822a8274400c352e, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 14:54:56,193 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for bb974e53dc6d462888c86a0e83d2293c in 1684ms, sequenceid=5, compaction requested=false 2023-10-30 14:54:56,193 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bb974e53dc6d462888c86a0e83d2293c: 2023-10-30 14:54:56,193 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:54:56,193 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 14:54:56,193 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 14:54:56,193 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,193 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-30 14:54:56,193 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-30 14:54:56,194 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:56,194 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:56,195 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:56,195 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:56,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:56,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-30 14:54:56,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15280577[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:56,196 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-30 14:54:56,196 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:56,197 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:56,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:56,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:56,197 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-30 14:54:56,197 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,197 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:56,197 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-30 14:54:56,197 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:56,198 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:56,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:56,198 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-30 14:54:56,198 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:56,198 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-30 14:54:56,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:56,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:56,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:56,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:56,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:56,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:56,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-30 14:54:56,200 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-30 14:54:56,200 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:56,200 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:56,200 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-30 14:54:56,200 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:56,201 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:56,201 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:56,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:56,201 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:56,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:56,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:56,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:56,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:56,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:56,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:56,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:56,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:56,202 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:56,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:56,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:56,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,203 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:56,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:56,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,205 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,205 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:56,205 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:56,205 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:56,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:56,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:56,210 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:56,210 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:56,210 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-30 14:54:56,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:56,211 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:56,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-30 14:54:56,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:56,211 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:56,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:56,211 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:56,211 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:56,211 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:56,311 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:56,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:56,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:56,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:56,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:56,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:56,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-30 14:54:56,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-30 14:54:56,330 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-30 14:54:56,330 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:56,330 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-30 14:54:56,331 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-30 14:54:56,331 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:56,331 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:56,332 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:56,332 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:56,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:56,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:56,333 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,333 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:56,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:56,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:56,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:56,333 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-30 14:54:56,335 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-30 14:54:56,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-30 14:54:56,335 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-30 14:54:56,335 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:56,335 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-30 14:54:56,343 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:54:56,344 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. started... 2023-10-30 14:54:56,344 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 953b179baa5064d7c5b98a46f266b330 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 14:54:56,346 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:54:56,347 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. started... 2023-10-30 14:54:56,347 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ab337776724960eefa44070b970f617f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 14:54:56,351 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 14:54:56,351 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:56,351 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:54:56,351 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. started... 2023-10-30 14:54:56,351 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bb974e53dc6d462888c86a0e83d2293c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 14:54:56,395 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103074181880852b4e52baa112e45a432d87 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023103074181880852b4e52baa112e45a432d87 2023-10-30 14:54:56,395 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030b84324c9e00a4bed94f61b51abb47685 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231030b84324c9e00a4bed94f61b51abb47685 2023-10-30 14:54:56,405 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030c3250235787a4b2fbae3ee4e4f3a341b to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231030c3250235787a4b2fbae3ee4e4f3a341b 2023-10-30 14:54:56,420 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family1/c5409b5a96bc4a18ab9c34b4d8184190 2023-10-30 14:54:56,420 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family1/5eaf0950563441338588d60e19a3fffd 2023-10-30 14:54:56,427 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family1/27a3f9dae5dc4d98a19be37970bb5701 2023-10-30 14:54:56,463 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103012bafa25e0134b48b93a44ca17ec3b53 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023103012bafa25e0134b48b93a44ca17ec3b53 2023-10-30 14:54:56,491 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030e1be12c2ee4c4275b6d6aa5f1ebcd3dd to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231030e1be12c2ee4c4275b6d6aa5f1ebcd3dd 2023-10-30 14:54:56,502 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family2/3bb9190b531141c4a36be53a436a7f6d 2023-10-30 14:54:56,503 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family2/0c9aa1ac7b584646b47ff20c7b138b3d 2023-10-30 14:54:56,507 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family1/5eaf0950563441338588d60e19a3fffd as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/5eaf0950563441338588d60e19a3fffd 2023-10-30 14:54:56,511 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/5eaf0950563441338588d60e19a3fffd, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 14:54:56,512 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family2/3bb9190b531141c4a36be53a436a7f6d as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/3bb9190b531141c4a36be53a436a7f6d 2023-10-30 14:54:56,517 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/3bb9190b531141c4a36be53a436a7f6d, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 14:54:56,518 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 953b179baa5064d7c5b98a46f266b330 in 174ms, sequenceid=9, compaction requested=false 2023-10-30 14:54:56,518 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 953b179baa5064d7c5b98a46f266b330: 2023-10-30 14:54:56,519 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:54:56,519 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 14:54:56,519 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family1/c5409b5a96bc4a18ab9c34b4d8184190 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/c5409b5a96bc4a18ab9c34b4d8184190 2023-10-30 14:54:56,522 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/c5409b5a96bc4a18ab9c34b4d8184190, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 14:54:56,523 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family2/0c9aa1ac7b584646b47ff20c7b138b3d as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/0c9aa1ac7b584646b47ff20c7b138b3d 2023-10-30 14:54:56,526 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/0c9aa1ac7b584646b47ff20c7b138b3d, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 14:54:56,527 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for bb974e53dc6d462888c86a0e83d2293c in 176ms, sequenceid=9, compaction requested=false 2023-10-30 14:54:56,527 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bb974e53dc6d462888c86a0e83d2293c: 2023-10-30 14:54:56,527 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:54:56,527 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 14:54:56,898 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103056be58b9e2a040e2a905ed7e23ce5e6f to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023103056be58b9e2a040e2a905ed7e23ce5e6f 2023-10-30 14:54:56,926 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family2/cddba734922c41799586f4b9afd69870 2023-10-30 14:54:56,934 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family1/27a3f9dae5dc4d98a19be37970bb5701 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/27a3f9dae5dc4d98a19be37970bb5701 2023-10-30 14:54:56,940 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/27a3f9dae5dc4d98a19be37970bb5701, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 14:54:56,940 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family2/cddba734922c41799586f4b9afd69870 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/cddba734922c41799586f4b9afd69870 2023-10-30 14:54:56,954 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/cddba734922c41799586f4b9afd69870, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 14:54:56,955 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ab337776724960eefa44070b970f617f in 608ms, sequenceid=9, compaction requested=false 2023-10-30 14:54:56,956 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ab337776724960eefa44070b970f617f: 2023-10-30 14:54:56,956 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:54:56,958 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 14:54:56,958 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 14:54:56,958 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,958 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-30 14:54:56,958 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-30 14:54:56,961 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:56,962 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:56,962 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:56,965 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:56,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-30 14:54:56,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@104c059f[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:56,968 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-30 14:54:56,968 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:56,973 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,973 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:56,985 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:56,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:56,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:56,986 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-30 14:54:56,986 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-30 14:54:56,986 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:56,996 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-30 14:54:56,996 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,996 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:56,996 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-30 14:54:56,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:56,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:56,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:56,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:56,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:57,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:57,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:57,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:57,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:57,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:57,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:57,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-30 14:54:57,004 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-30 14:54:57,004 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:57,004 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:57,004 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-30 14:54:57,004 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:57,013 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:57,013 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:57,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:57,013 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:57,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:57,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:57,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:57,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:57,014 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:57,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:57,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:57,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:57,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:57,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:57,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:57,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:57,018 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:57,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:57,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:57,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:57,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:57,021 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:57,021 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:57,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:57,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:57,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:57,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:57,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-30 14:54:57,022 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:57,026 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:57,026 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:57,026 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:57,026 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:57,026 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:57,026 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:57,026 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:57,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-30 14:54:57,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:57,027 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:57,027 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:57,127 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:57,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:57,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:57,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:57,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:57,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:57,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-30 14:54:57,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-30 14:54:57,136 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-30 14:54:57,136 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:57,136 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-30 14:54:57,136 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-30 14:54:57,137 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:57,137 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:57,138 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:57,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:57,138 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:57,140 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:57,140 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:57,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:57,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:57,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:57,142 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-30 14:54:57,143 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-30 14:54:57,143 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-30 14:54:57,143 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-30 14:54:57,143 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:57,143 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-30 14:54:57,144 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:54:57,144 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. started... 2023-10-30 14:54:57,144 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 953b179baa5064d7c5b98a46f266b330 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 14:54:57,150 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 14:54:57,150 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:57,150 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:54:57,150 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. started... 2023-10-30 14:54:57,150 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ab337776724960eefa44070b970f617f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 14:54:57,150 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:54:57,150 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. started... 2023-10-30 14:54:57,151 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bb974e53dc6d462888c86a0e83d2293c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 14:54:57,220 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310301bff02d74d894300823ae7af93913a4a to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310301bff02d74d894300823ae7af93913a4a 2023-10-30 14:54:57,221 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030c12401ac12824887908c972af7220f26 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231030c12401ac12824887908c972af7220f26 2023-10-30 14:54:57,234 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310308f95d58657da400d84d0b337b8ddf0e1 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310308f95d58657da400d84d0b337b8ddf0e1 2023-10-30 14:54:57,259 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family1/fa01ff0b5da540fb88c8257b7fd38b28 2023-10-30 14:54:57,261 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family1/97db172b0de84836be63b1b3fdfd7f23 2023-10-30 14:54:57,293 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310308fd95be6e35442379efbff2f97a4ee70 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202310308fd95be6e35442379efbff2f97a4ee70 2023-10-30 14:54:57,294 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103008767ad75c704ed0b8048b7661606e4e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023103008767ad75c704ed0b8048b7661606e4e 2023-10-30 14:54:57,316 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family2/652690bdc5174f16b9dcd304ef990192 2023-10-30 14:54:57,322 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family1/fa01ff0b5da540fb88c8257b7fd38b28 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/fa01ff0b5da540fb88c8257b7fd38b28 2023-10-30 14:54:57,340 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/fa01ff0b5da540fb88c8257b7fd38b28, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 14:54:57,341 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family2/652690bdc5174f16b9dcd304ef990192 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/652690bdc5174f16b9dcd304ef990192 2023-10-30 14:54:57,345 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/652690bdc5174f16b9dcd304ef990192, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 14:54:57,346 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ab337776724960eefa44070b970f617f in 196ms, sequenceid=13, compaction requested=true 2023-10-30 14:54:57,347 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ab337776724960eefa44070b970f617f: 2023-10-30 14:54:57,347 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:54:57,347 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 14:54:57,661 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family1/c1d927f006a042009d0f06c67dc36ece 2023-10-30 14:54:57,714 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family2/5f665e3f3edb4dc683ca08091f60cfd8 2023-10-30 14:54:57,721 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family1/97db172b0de84836be63b1b3fdfd7f23 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/97db172b0de84836be63b1b3fdfd7f23 2023-10-30 14:54:57,725 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/97db172b0de84836be63b1b3fdfd7f23, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 14:54:57,726 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family2/5f665e3f3edb4dc683ca08091f60cfd8 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/5f665e3f3edb4dc683ca08091f60cfd8 2023-10-30 14:54:57,732 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/5f665e3f3edb4dc683ca08091f60cfd8, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 14:54:57,733 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 953b179baa5064d7c5b98a46f266b330 in 589ms, sequenceid=13, compaction requested=true 2023-10-30 14:54:57,733 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 953b179baa5064d7c5b98a46f266b330: 2023-10-30 14:54:57,733 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:54:57,733 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 14:54:58,076 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103008dfbe36e5d9435f92a2f353a0c34196 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023103008dfbe36e5d9435f92a2f353a0c34196 2023-10-30 14:54:58,092 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family2/11b63414a0e14e07807da814bde72bca 2023-10-30 14:54:58,096 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family1/c1d927f006a042009d0f06c67dc36ece as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/c1d927f006a042009d0f06c67dc36ece 2023-10-30 14:54:58,103 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/c1d927f006a042009d0f06c67dc36ece, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 14:54:58,104 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family2/11b63414a0e14e07807da814bde72bca as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/11b63414a0e14e07807da814bde72bca 2023-10-30 14:54:58,110 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/11b63414a0e14e07807da814bde72bca, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 14:54:58,111 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for bb974e53dc6d462888c86a0e83d2293c in 961ms, sequenceid=13, compaction requested=true 2023-10-30 14:54:58,111 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bb974e53dc6d462888c86a0e83d2293c: 2023-10-30 14:54:58,111 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:54:58,111 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 14:54:58,111 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 14:54:58,111 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:58,111 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-30 14:54:58,111 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-30 14:54:58,112 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:58,114 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:58,114 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:58,114 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:58,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-30 14:54:58,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@122e2f6a[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:58,115 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-30 14:54:58,115 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:58,116 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:58,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:58,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:58,116 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-30 14:54:58,116 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-30 14:54:58,116 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:58,116 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:58,116 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:58,117 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-30 14:54:58,117 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:58,117 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:58,117 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-30 14:54:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:58,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:58,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-30 14:54:58,119 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-30 14:54:58,119 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:58,119 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:58,119 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-30 14:54:58,119 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:58,120 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:58,120 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:58,120 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:58,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:58,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:58,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:58,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:58,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:58,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:58,121 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:58,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:58,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:58,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:58,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:58,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:58,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:58,122 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:58,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:58,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:58,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:58,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:58,129 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:58,129 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:58,129 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:58,130 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:58,130 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:58,130 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:58,130 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:58,130 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:58,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-30 14:54:58,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:58,130 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:58,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:58,130 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:58,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:58,131 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:58,131 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:54:58,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:58,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:58,231 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:54:58,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:54:58,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:58,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:58,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:54:58,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:54:58,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-30 14:54:58,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-30 14:54:58,239 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-30 14:54:58,239 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:58,239 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-30 14:54:58,239 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-30 14:54:58,240 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:58,240 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:58,240 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:58,240 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:58,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:58,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:58,241 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:58,241 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:54:58,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:58,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:58,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:54:58,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:58,243 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-30 14:54:58,245 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-30 14:54:58,245 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-30 14:54:58,245 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-30 14:54:58,245 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:54:58,245 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-30 14:54:58,247 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:54:58,247 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:54:58,247 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. started... 2023-10-30 14:54:58,247 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ab337776724960eefa44070b970f617f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 14:54:58,247 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 14:54:58,247 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:54:58,247 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:54:58,247 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. started... 2023-10-30 14:54:58,247 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. started... 2023-10-30 14:54:58,249 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bb974e53dc6d462888c86a0e83d2293c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 14:54:58,249 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 953b179baa5064d7c5b98a46f266b330 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 14:54:58,276 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103063d4882890cf4d949c226ac1328951df to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023103063d4882890cf4d949c226ac1328951df 2023-10-30 14:54:58,290 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030ec902c021dba4da685e18f7aa2d57ea5 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231030ec902c021dba4da685e18f7aa2d57ea5 2023-10-30 14:54:58,305 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family1/9897493a175e4b70bb8616e308ffbe3c 2023-10-30 14:54:58,676 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030ebdf835fff6f4bcca81f3f83700285c4 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231030ebdf835fff6f4bcca81f3f83700285c4 2023-10-30 14:54:58,706 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family1/14d6009a1da04a47932cdc7ee65cec41 2023-10-30 14:54:58,727 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030acd555a4169a42eeb3a759c58e07c34e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231030acd555a4169a42eeb3a759c58e07c34e 2023-10-30 14:54:59,046 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 14:54:59,087 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family1/eb70b7c1f0ce4ae4b707220bedd75776 2023-10-30 14:54:59,122 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030f04b1db87b914dc78afe2795d6f5d4da to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231030f04b1db87b914dc78afe2795d6f5d4da 2023-10-30 14:54:59,138 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family2/0c86cd5fc3174c429d01a6625b355e23 2023-10-30 14:54:59,146 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family1/9897493a175e4b70bb8616e308ffbe3c as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/9897493a175e4b70bb8616e308ffbe3c 2023-10-30 14:54:59,150 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/9897493a175e4b70bb8616e308ffbe3c, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 14:54:59,151 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family2/0c86cd5fc3174c429d01a6625b355e23 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/0c86cd5fc3174c429d01a6625b355e23 2023-10-30 14:54:59,155 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/0c86cd5fc3174c429d01a6625b355e23, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 14:54:59,156 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for bb974e53dc6d462888c86a0e83d2293c in 907ms, sequenceid=17, compaction requested=true 2023-10-30 14:54:59,156 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bb974e53dc6d462888c86a0e83d2293c: 2023-10-30 14:54:59,156 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:54:59,156 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 14:54:59,517 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310302f9f8b4cac0e4d828fd93793e88ab3dd to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202310302f9f8b4cac0e4d828fd93793e88ab3dd 2023-10-30 14:54:59,534 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family2/30566633e4fa4c77967610bfe2efea2d 2023-10-30 14:54:59,539 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family1/14d6009a1da04a47932cdc7ee65cec41 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/14d6009a1da04a47932cdc7ee65cec41 2023-10-30 14:54:59,546 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/14d6009a1da04a47932cdc7ee65cec41, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 14:54:59,546 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family2/30566633e4fa4c77967610bfe2efea2d as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/30566633e4fa4c77967610bfe2efea2d 2023-10-30 14:54:59,552 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/30566633e4fa4c77967610bfe2efea2d, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 14:54:59,554 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ab337776724960eefa44070b970f617f in 1307ms, sequenceid=17, compaction requested=true 2023-10-30 14:54:59,554 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ab337776724960eefa44070b970f617f: 2023-10-30 14:54:59,554 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:54:59,554 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 14:54:59,929 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family2/64a8ac50b5204d07a8bf8da8ff5ca866 2023-10-30 14:54:59,933 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family1/eb70b7c1f0ce4ae4b707220bedd75776 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/eb70b7c1f0ce4ae4b707220bedd75776 2023-10-30 14:54:59,937 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/eb70b7c1f0ce4ae4b707220bedd75776, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 14:54:59,938 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family2/64a8ac50b5204d07a8bf8da8ff5ca866 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/64a8ac50b5204d07a8bf8da8ff5ca866 2023-10-30 14:54:59,945 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/64a8ac50b5204d07a8bf8da8ff5ca866, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 14:54:59,945 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 953b179baa5064d7c5b98a46f266b330 in 1696ms, sequenceid=17, compaction requested=true 2023-10-30 14:54:59,945 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 953b179baa5064d7c5b98a46f266b330: 2023-10-30 14:54:59,946 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:54:59,946 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 14:54:59,946 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 14:54:59,946 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:59,946 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-30 14:54:59,946 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-30 14:54:59,949 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:59,949 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:59,949 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:54:59,950 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:59,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:59,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:59,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:59,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:59,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:59,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:59,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:59,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:59,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-30 14:54:59,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ff7e98f[Count = 0] remaining members to acquire global barrier 2023-10-30 14:54:59,952 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-30 14:54:59,952 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:59,952 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:59,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:59,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:59,952 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-30 14:54:59,952 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-30 14:54:59,952 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:54:59,952 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:59,952 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:54:59,953 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-30 14:54:59,953 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:59,953 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:59,953 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-30 14:54:59,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:59,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:59,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:59,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:59,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:59,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:59,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:59,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:59,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:59,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:59,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:54:59,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-30 14:54:59,955 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-30 14:54:59,955 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:54:59,955 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:54:59,955 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-30 14:54:59,955 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:54:59,956 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:59,956 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:59,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:59,956 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:59,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:59,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:59,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:54:59,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:54:59,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:59,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:59,956 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:59,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:54:59,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:59,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:59,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:54:59,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:59,957 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:59,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:59,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:54:59,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:54:59,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:59,958 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:59,958 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:54:59,958 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:59,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:54:59,958 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:54:59,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-30 14:54:59,958 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-30 14:54:59,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:54:59,958 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:54:59,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:54:59,958 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:54:59,959 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:54:59,959 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:59,959 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:54:59,959 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:54:59,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:54:59,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:54:59,959 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-30 14:54:59,959 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:55:00,059 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:55:00,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:55:00,088 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:55:00,107 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:55:00,128 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:55:00,131 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:55:00,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:55:00,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-30 14:55:00,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-30 14:55:00,202 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-30 14:55:00,202 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:00,202 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-30 14:55:00,202 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-30 14:55:00,203 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:55:00,203 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:55:00,203 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:00,203 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:00,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:00,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:00,204 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:00,204 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:55:00,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:55:00,204 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:55:00,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:55:00,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:55:00,204 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-30 14:55:00,204 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-30 14:55:00,204 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-30 14:55:00,205 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-30 14:55:00,205 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:00,205 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-30 14:55:00,210 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:55:00,210 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. started... 2023-10-30 14:55:00,210 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:55:00,210 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. started... 2023-10-30 14:55:00,210 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 953b179baa5064d7c5b98a46f266b330 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 14:55:00,210 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ab337776724960eefa44070b970f617f 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 14:55:00,214 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 14:55:00,214 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:55:00,217 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:55:00,218 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. started... 2023-10-30 14:55:00,218 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bb974e53dc6d462888c86a0e83d2293c 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 14:55:00,267 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family1/5a7d0f38793e423e88ec0250b0eb79ad 2023-10-30 14:55:00,276 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a7d0f38793e423e88ec0250b0eb79ad 2023-10-30 14:55:00,667 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family1/4200df7c019b4da0bd5ee4f2fc1517ef 2023-10-30 14:55:00,670 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4200df7c019b4da0bd5ee4f2fc1517ef 2023-10-30 14:55:00,698 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family2/60190e610c9b41728de9f3bc36097646 2023-10-30 14:55:00,702 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60190e610c9b41728de9f3bc36097646 2023-10-30 14:55:00,703 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family1/5a7d0f38793e423e88ec0250b0eb79ad as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/5a7d0f38793e423e88ec0250b0eb79ad 2023-10-30 14:55:00,710 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a7d0f38793e423e88ec0250b0eb79ad 2023-10-30 14:55:00,710 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/5a7d0f38793e423e88ec0250b0eb79ad, entries=3, sequenceid=23, filesize=5.0 K 2023-10-30 14:55:00,712 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family2/60190e610c9b41728de9f3bc36097646 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/60190e610c9b41728de9f3bc36097646 2023-10-30 14:55:00,716 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60190e610c9b41728de9f3bc36097646 2023-10-30 14:55:00,716 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/60190e610c9b41728de9f3bc36097646, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 14:55:00,717 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for bb974e53dc6d462888c86a0e83d2293c in 499ms, sequenceid=23, compaction requested=true 2023-10-30 14:55:00,717 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bb974e53dc6d462888c86a0e83d2293c: 2023-10-30 14:55:00,717 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:55:00,717 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 14:55:01,060 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family1/4f324f2d0c474118b6bba2879e6c8f84 2023-10-30 14:55:01,068 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f324f2d0c474118b6bba2879e6c8f84 2023-10-30 14:55:01,484 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family2/0986d06087d446e69f4d7202300e0354 2023-10-30 14:55:01,487 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0986d06087d446e69f4d7202300e0354 2023-10-30 14:55:01,487 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family1/4200df7c019b4da0bd5ee4f2fc1517ef as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/4200df7c019b4da0bd5ee4f2fc1517ef 2023-10-30 14:55:01,491 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4200df7c019b4da0bd5ee4f2fc1517ef 2023-10-30 14:55:01,491 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/4200df7c019b4da0bd5ee4f2fc1517ef, entries=3, sequenceid=23, filesize=5.0 K 2023-10-30 14:55:01,492 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family2/0986d06087d446e69f4d7202300e0354 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/0986d06087d446e69f4d7202300e0354 2023-10-30 14:55:01,495 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0986d06087d446e69f4d7202300e0354 2023-10-30 14:55:01,495 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/0986d06087d446e69f4d7202300e0354, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 14:55:01,496 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 953b179baa5064d7c5b98a46f266b330 in 1286ms, sequenceid=23, compaction requested=true 2023-10-30 14:55:01,496 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 953b179baa5064d7c5b98a46f266b330: 2023-10-30 14:55:01,496 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:55:01,496 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 14:55:01,882 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family2/1b3a76be6a8e4e04af0f155598b86e56 2023-10-30 14:55:01,887 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b3a76be6a8e4e04af0f155598b86e56 2023-10-30 14:55:01,887 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family1/4f324f2d0c474118b6bba2879e6c8f84 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/4f324f2d0c474118b6bba2879e6c8f84 2023-10-30 14:55:01,891 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f324f2d0c474118b6bba2879e6c8f84 2023-10-30 14:55:01,891 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/4f324f2d0c474118b6bba2879e6c8f84, entries=3, sequenceid=23, filesize=5.0 K 2023-10-30 14:55:01,893 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family2/1b3a76be6a8e4e04af0f155598b86e56 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/1b3a76be6a8e4e04af0f155598b86e56 2023-10-30 14:55:01,899 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b3a76be6a8e4e04af0f155598b86e56 2023-10-30 14:55:01,899 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/1b3a76be6a8e4e04af0f155598b86e56, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 14:55:01,900 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ab337776724960eefa44070b970f617f in 1690ms, sequenceid=23, compaction requested=true 2023-10-30 14:55:01,900 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ab337776724960eefa44070b970f617f: 2023-10-30 14:55:01,900 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:55:01,900 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 14:55:01,900 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 14:55:01,900 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:01,900 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-30 14:55:01,900 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-30 14:55:01,902 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:55:01,902 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:01,902 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:55:01,902 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:55:01,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:01,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:01,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:01,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:01,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:01,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:55:01,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:01,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:01,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-30 14:55:01,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a2154bb[Count = 0] remaining members to acquire global barrier 2023-10-30 14:55:01,904 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-30 14:55:01,904 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:55:01,906 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:55:01,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:55:01,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:55:01,906 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-30 14:55:01,906 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-30 14:55:01,906 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:55:01,906 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:01,906 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:55:01,907 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-30 14:55:01,907 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:01,907 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:01,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:01,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:01,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:01,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:01,907 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-30 14:55:01,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:01,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:55:01,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:01,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:01,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:55:01,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:01,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:55:01,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-30 14:55:01,909 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-30 14:55:01,909 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:55:01,909 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:55:01,909 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-30 14:55:01,909 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:55:01,911 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:55:01,911 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:01,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:55:01,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:55:01,913 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:55:01,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:55:01,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:01,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:01,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:01,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:01,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:55:01,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:01,914 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:01,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:55:01,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:55:01,916 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:01,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 14:55:01,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:01,918 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:01,918 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:01,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-30 14:55:01,921 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:01,921 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:55:01,921 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 14:55:01,921 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:01,921 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:55:01,921 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 14:55:01,921 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 14:55:01,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:01,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:01,921 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:01,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-30 14:55:01,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:55:01,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:01,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:01,921 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-30 14:55:01,922 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:55:02,022 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:55:02,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:55:02,023 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:55:02,023 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): 953b179baa5064d7c5b98a46f266b330/family1 is initiating major compaction (all files) 2023-10-30 14:55:02,023 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:55:02,023 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:55:02,024 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of 953b179baa5064d7c5b98a46f266b330/family1 in ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:55:02,024 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/d0a9babe230146abad63ece78a4a8d7a, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/5eaf0950563441338588d60e19a3fffd, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/97db172b0de84836be63b1b3fdfd7f23, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/eb70b7c1f0ce4ae4b707220bedd75776, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/4200df7c019b4da0bd5ee4f2fc1517ef] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp, totalSize=26.6 K 2023-10-30 14:55:02,025 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting d0a9babe230146abad63ece78a4a8d7a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677694500 2023-10-30 14:55:02,026 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 5eaf0950563441338588d60e19a3fffd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677696314 2023-10-30 14:55:02,026 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 97db172b0de84836be63b1b3fdfd7f23, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677697130 2023-10-30 14:55:02,027 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting eb70b7c1f0ce4ae4b707220bedd75776, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677698234 2023-10-30 14:55:02,027 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 4200df7c019b4da0bd5ee4f2fc1517ef, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 14:55:02,061 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): 953b179baa5064d7c5b98a46f266b330#family1#compaction#150 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:55:02,477 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310304440d56f4c794c34a1a3ef2f9965e19b_del 2023-10-30 14:55:02,477 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310304440d56f4c794c34a1a3ef2f9965e19b_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202310304440d56f4c794c34a1a3ef2f9965e19b_del 2023-10-30 14:55:03,295 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 109e9a08ab3c4b4b9094dd138e43ce09 2023-10-30 14:55:03,296 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family1/109e9a08ab3c4b4b9094dd138e43ce09 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/109e9a08ab3c4b4b9094dd138e43ce09 2023-10-30 14:55:03,306 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 109e9a08ab3c4b4b9094dd138e43ce09 2023-10-30 14:55:03,307 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 953b179baa5064d7c5b98a46f266b330/family1 of 953b179baa5064d7c5b98a46f266b330 into 109e9a08ab3c4b4b9094dd138e43ce09(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:55:03,307 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for 953b179baa5064d7c5b98a46f266b330: 2023-10-30 14:55:03,307 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:55:03,307 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): 953b179baa5064d7c5b98a46f266b330/family2 is initiating major compaction (all files) 2023-10-30 14:55:03,307 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:55:03,307 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:55:03,307 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of 953b179baa5064d7c5b98a46f266b330/family2 in ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:55:03,307 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/a90fc83357fe488c9d45a6e48c614368, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/3bb9190b531141c4a36be53a436a7f6d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/5f665e3f3edb4dc683ca08091f60cfd8, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/64a8ac50b5204d07a8bf8da8ff5ca866, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/0986d06087d446e69f4d7202300e0354] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp, totalSize=25.3 K 2023-10-30 14:55:03,308 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting a90fc83357fe488c9d45a6e48c614368, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677694500 2023-10-30 14:55:03,308 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 3bb9190b531141c4a36be53a436a7f6d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677696314 2023-10-30 14:55:03,308 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 5f665e3f3edb4dc683ca08091f60cfd8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677697130 2023-10-30 14:55:03,309 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 64a8ac50b5204d07a8bf8da8ff5ca866, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677698234 2023-10-30 14:55:03,309 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 0986d06087d446e69f4d7202300e0354, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 14:55:03,326 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): 953b179baa5064d7c5b98a46f266b330#family2#compaction#151 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:55:03,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/d0a9babe230146abad63ece78a4a8d7a, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/5eaf0950563441338588d60e19a3fffd, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/97db172b0de84836be63b1b3fdfd7f23, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/eb70b7c1f0ce4ae4b707220bedd75776, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/4200df7c019b4da0bd5ee4f2fc1517ef] to archive 2023-10-30 14:55:03,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:03,411 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/d0a9babe230146abad63ece78a4a8d7a to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/d0a9babe230146abad63ece78a4a8d7a 2023-10-30 14:55:03,412 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/5eaf0950563441338588d60e19a3fffd to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/5eaf0950563441338588d60e19a3fffd 2023-10-30 14:55:03,415 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/97db172b0de84836be63b1b3fdfd7f23 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/97db172b0de84836be63b1b3fdfd7f23 2023-10-30 14:55:03,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/eb70b7c1f0ce4ae4b707220bedd75776 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/eb70b7c1f0ce4ae4b707220bedd75776 2023-10-30 14:55:03,417 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/4200df7c019b4da0bd5ee4f2fc1517ef to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/4200df7c019b4da0bd5ee4f2fc1517ef 2023-10-30 14:55:03,744 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023103079e56b87fbb44285ae7e114d798d961c_del 2023-10-30 14:55:03,744 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103079e56b87fbb44285ae7e114d798d961c_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023103079e56b87fbb44285ae7e114d798d961c_del 2023-10-30 14:55:03,770 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6833e051d4c40dea3e04586533e6b6f 2023-10-30 14:55:03,774 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/.tmp/family2/a6833e051d4c40dea3e04586533e6b6f as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/a6833e051d4c40dea3e04586533e6b6f 2023-10-30 14:55:03,784 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6833e051d4c40dea3e04586533e6b6f 2023-10-30 14:55:03,785 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 953b179baa5064d7c5b98a46f266b330/family2 of 953b179baa5064d7c5b98a46f266b330 into a6833e051d4c40dea3e04586533e6b6f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:55:03,785 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for 953b179baa5064d7c5b98a46f266b330: 2023-10-30 14:55:03,786 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:55:03,786 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): ab337776724960eefa44070b970f617f/family1 is initiating major compaction (all files) 2023-10-30 14:55:03,786 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:55:03,786 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:55:03,787 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of ab337776724960eefa44070b970f617f/family1 in ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:55:03,787 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/5a0f4e56b4f342289372fae9f8dedde6, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/27a3f9dae5dc4d98a19be37970bb5701, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/fa01ff0b5da540fb88c8257b7fd38b28, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/14d6009a1da04a47932cdc7ee65cec41, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/4f324f2d0c474118b6bba2879e6c8f84] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp, totalSize=26.6 K 2023-10-30 14:55:03,787 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 5a0f4e56b4f342289372fae9f8dedde6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677694500 2023-10-30 14:55:03,788 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 27a3f9dae5dc4d98a19be37970bb5701, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677696314 2023-10-30 14:55:03,788 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting fa01ff0b5da540fb88c8257b7fd38b28, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677697130 2023-10-30 14:55:03,788 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 14d6009a1da04a47932cdc7ee65cec41, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677698233 2023-10-30 14:55:03,794 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 4f324f2d0c474118b6bba2879e6c8f84, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 14:55:03,800 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/a90fc83357fe488c9d45a6e48c614368, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/3bb9190b531141c4a36be53a436a7f6d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/5f665e3f3edb4dc683ca08091f60cfd8, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/64a8ac50b5204d07a8bf8da8ff5ca866, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/0986d06087d446e69f4d7202300e0354] to archive 2023-10-30 14:55:03,801 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:03,803 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/a90fc83357fe488c9d45a6e48c614368 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/a90fc83357fe488c9d45a6e48c614368 2023-10-30 14:55:03,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/3bb9190b531141c4a36be53a436a7f6d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/3bb9190b531141c4a36be53a436a7f6d 2023-10-30 14:55:03,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/5f665e3f3edb4dc683ca08091f60cfd8 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/5f665e3f3edb4dc683ca08091f60cfd8 2023-10-30 14:55:03,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/64a8ac50b5204d07a8bf8da8ff5ca866 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/64a8ac50b5204d07a8bf8da8ff5ca866 2023-10-30 14:55:03,808 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): ab337776724960eefa44070b970f617f#family1#compaction#152 average throughput is 0.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:55:03,813 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/0986d06087d446e69f4d7202300e0354 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family2/0986d06087d446e69f4d7202300e0354 2023-10-30 14:55:04,223 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231030d49a6ecc55b84879a554ccaf75c31756_del 2023-10-30 14:55:04,224 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030d49a6ecc55b84879a554ccaf75c31756_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231030d49a6ecc55b84879a554ccaf75c31756_del 2023-10-30 14:55:04,642 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cd99b9a560d34b118928c6ae8c132835 2023-10-30 14:55:04,643 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family1/cd99b9a560d34b118928c6ae8c132835 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/cd99b9a560d34b118928c6ae8c132835 2023-10-30 14:55:04,646 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cd99b9a560d34b118928c6ae8c132835 2023-10-30 14:55:04,647 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ab337776724960eefa44070b970f617f/family1 of ab337776724960eefa44070b970f617f into cd99b9a560d34b118928c6ae8c132835(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:55:04,647 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for ab337776724960eefa44070b970f617f: 2023-10-30 14:55:04,647 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:55:04,647 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): ab337776724960eefa44070b970f617f/family2 is initiating major compaction (all files) 2023-10-30 14:55:04,647 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:55:04,647 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:55:04,647 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of ab337776724960eefa44070b970f617f/family2 in ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:55:04,647 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/b2f6cebbaef94604b9a93f6673471afd, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/cddba734922c41799586f4b9afd69870, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/652690bdc5174f16b9dcd304ef990192, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/30566633e4fa4c77967610bfe2efea2d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/1b3a76be6a8e4e04af0f155598b86e56] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp, totalSize=25.3 K 2023-10-30 14:55:04,648 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting b2f6cebbaef94604b9a93f6673471afd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677694500 2023-10-30 14:55:04,648 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting cddba734922c41799586f4b9afd69870, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677696314 2023-10-30 14:55:04,648 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 652690bdc5174f16b9dcd304ef990192, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677697130 2023-10-30 14:55:04,648 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 30566633e4fa4c77967610bfe2efea2d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677698233 2023-10-30 14:55:04,649 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 1b3a76be6a8e4e04af0f155598b86e56, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 14:55:04,665 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): ab337776724960eefa44070b970f617f#family2#compaction#153 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:55:04,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/5a0f4e56b4f342289372fae9f8dedde6, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/27a3f9dae5dc4d98a19be37970bb5701, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/fa01ff0b5da540fb88c8257b7fd38b28, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/14d6009a1da04a47932cdc7ee65cec41, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/4f324f2d0c474118b6bba2879e6c8f84] to archive 2023-10-30 14:55:04,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:04,701 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231030519b0186ea404128b5734c5f916e5bc7_del 2023-10-30 14:55:04,702 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030519b0186ea404128b5734c5f916e5bc7_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231030519b0186ea404128b5734c5f916e5bc7_del 2023-10-30 14:55:04,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/5a0f4e56b4f342289372fae9f8dedde6 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/5a0f4e56b4f342289372fae9f8dedde6 2023-10-30 14:55:04,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/27a3f9dae5dc4d98a19be37970bb5701 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/27a3f9dae5dc4d98a19be37970bb5701 2023-10-30 14:55:04,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/fa01ff0b5da540fb88c8257b7fd38b28 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/fa01ff0b5da540fb88c8257b7fd38b28 2023-10-30 14:55:04,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/14d6009a1da04a47932cdc7ee65cec41 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/14d6009a1da04a47932cdc7ee65cec41 2023-10-30 14:55:04,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/4f324f2d0c474118b6bba2879e6c8f84 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/4f324f2d0c474118b6bba2879e6c8f84 2023-10-30 14:55:05,125 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for acaccf6e4de44bf0a8a79aa8f4f16a6d 2023-10-30 14:55:05,126 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/.tmp/family2/acaccf6e4de44bf0a8a79aa8f4f16a6d as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/acaccf6e4de44bf0a8a79aa8f4f16a6d 2023-10-30 14:55:05,131 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for acaccf6e4de44bf0a8a79aa8f4f16a6d 2023-10-30 14:55:05,132 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ab337776724960eefa44070b970f617f/family2 of ab337776724960eefa44070b970f617f into acaccf6e4de44bf0a8a79aa8f4f16a6d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:55:05,132 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for ab337776724960eefa44070b970f617f: 2023-10-30 14:55:05,133 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:55:05,133 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): bb974e53dc6d462888c86a0e83d2293c/family1 is initiating major compaction (all files) 2023-10-30 14:55:05,133 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:55:05,133 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:55:05,133 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of bb974e53dc6d462888c86a0e83d2293c/family1 in ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:55:05,133 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/a34016349384441eb18143d45412ef49, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/c5409b5a96bc4a18ab9c34b4d8184190, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/c1d927f006a042009d0f06c67dc36ece, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/9897493a175e4b70bb8616e308ffbe3c, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/5a7d0f38793e423e88ec0250b0eb79ad] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp, totalSize=26.6 K 2023-10-30 14:55:05,134 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting a34016349384441eb18143d45412ef49, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677694500 2023-10-30 14:55:05,134 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting c5409b5a96bc4a18ab9c34b4d8184190, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677696313 2023-10-30 14:55:05,135 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting c1d927f006a042009d0f06c67dc36ece, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677697130 2023-10-30 14:55:05,135 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 9897493a175e4b70bb8616e308ffbe3c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677698233 2023-10-30 14:55:05,136 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 5a7d0f38793e423e88ec0250b0eb79ad, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 14:55:05,147 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): bb974e53dc6d462888c86a0e83d2293c#family1#compaction#154 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:55:05,200 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/b2f6cebbaef94604b9a93f6673471afd, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/cddba734922c41799586f4b9afd69870, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/652690bdc5174f16b9dcd304ef990192, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/30566633e4fa4c77967610bfe2efea2d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/1b3a76be6a8e4e04af0f155598b86e56] to archive 2023-10-30 14:55:05,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:05,202 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/b2f6cebbaef94604b9a93f6673471afd to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/b2f6cebbaef94604b9a93f6673471afd 2023-10-30 14:55:05,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/cddba734922c41799586f4b9afd69870 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/cddba734922c41799586f4b9afd69870 2023-10-30 14:55:05,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/652690bdc5174f16b9dcd304ef990192 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/652690bdc5174f16b9dcd304ef990192 2023-10-30 14:55:05,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/30566633e4fa4c77967610bfe2efea2d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/30566633e4fa4c77967610bfe2efea2d 2023-10-30 14:55:05,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/1b3a76be6a8e4e04af0f155598b86e56 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family2/1b3a76be6a8e4e04af0f155598b86e56 2023-10-30 14:55:05,563 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231030c10179cd2f32413ca2065f2fb55830cd_del 2023-10-30 14:55:05,563 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030c10179cd2f32413ca2065f2fb55830cd_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231030c10179cd2f32413ca2065f2fb55830cd_del 2023-10-30 14:55:06,395 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d965508bc8e4457f9b1646bb2c30655a 2023-10-30 14:55:06,396 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family1/d965508bc8e4457f9b1646bb2c30655a as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/d965508bc8e4457f9b1646bb2c30655a 2023-10-30 14:55:06,402 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d965508bc8e4457f9b1646bb2c30655a 2023-10-30 14:55:06,403 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bb974e53dc6d462888c86a0e83d2293c/family1 of bb974e53dc6d462888c86a0e83d2293c into d965508bc8e4457f9b1646bb2c30655a(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:55:06,403 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for bb974e53dc6d462888c86a0e83d2293c: 2023-10-30 14:55:06,403 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:55:06,403 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): bb974e53dc6d462888c86a0e83d2293c/family2 is initiating major compaction (all files) 2023-10-30 14:55:06,404 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:55:06,404 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:55:06,404 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of bb974e53dc6d462888c86a0e83d2293c/family2 in ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:55:06,405 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/f6ce72f8c9124493822a8274400c352e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/0c9aa1ac7b584646b47ff20c7b138b3d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/11b63414a0e14e07807da814bde72bca, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/0c86cd5fc3174c429d01a6625b355e23, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/60190e610c9b41728de9f3bc36097646] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp, totalSize=25.3 K 2023-10-30 14:55:06,405 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting f6ce72f8c9124493822a8274400c352e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677694500 2023-10-30 14:55:06,405 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 0c9aa1ac7b584646b47ff20c7b138b3d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677696313 2023-10-30 14:55:06,406 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 11b63414a0e14e07807da814bde72bca, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677697130 2023-10-30 14:55:06,406 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 0c86cd5fc3174c429d01a6625b355e23, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677698233 2023-10-30 14:55:06,407 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 60190e610c9b41728de9f3bc36097646, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 14:55:06,417 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): bb974e53dc6d462888c86a0e83d2293c#family2#compaction#155 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:55:06,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/a34016349384441eb18143d45412ef49, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/c5409b5a96bc4a18ab9c34b4d8184190, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/c1d927f006a042009d0f06c67dc36ece, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/9897493a175e4b70bb8616e308ffbe3c, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/5a7d0f38793e423e88ec0250b0eb79ad] to archive 2023-10-30 14:55:06,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:06,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/a34016349384441eb18143d45412ef49 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/a34016349384441eb18143d45412ef49 2023-10-30 14:55:06,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/c5409b5a96bc4a18ab9c34b4d8184190 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/c5409b5a96bc4a18ab9c34b4d8184190 2023-10-30 14:55:06,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/c1d927f006a042009d0f06c67dc36ece to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/c1d927f006a042009d0f06c67dc36ece 2023-10-30 14:55:06,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/9897493a175e4b70bb8616e308ffbe3c to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/9897493a175e4b70bb8616e308ffbe3c 2023-10-30 14:55:06,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/5a7d0f38793e423e88ec0250b0eb79ad to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/5a7d0f38793e423e88ec0250b0eb79ad 2023-10-30 14:55:06,829 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231030452263782f004951afbebce53c0872fd_del 2023-10-30 14:55:06,829 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030452263782f004951afbebce53c0872fd_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231030452263782f004951afbebce53c0872fd_del 2023-10-30 14:55:07,660 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 322f9b45323f469c89676c1bc182285b 2023-10-30 14:55:07,662 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/.tmp/family2/322f9b45323f469c89676c1bc182285b as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/322f9b45323f469c89676c1bc182285b 2023-10-30 14:55:07,671 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 322f9b45323f469c89676c1bc182285b 2023-10-30 14:55:07,672 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bb974e53dc6d462888c86a0e83d2293c/family2 of bb974e53dc6d462888c86a0e83d2293c into 322f9b45323f469c89676c1bc182285b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:55:07,672 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for bb974e53dc6d462888c86a0e83d2293c: 2023-10-30 14:55:07,677 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:55:07,680 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:55:07,684 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:55:07,685 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:55:07,691 INFO [Listener at localhost/34621] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 14:55:07,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/f6ce72f8c9124493822a8274400c352e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/0c9aa1ac7b584646b47ff20c7b138b3d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/11b63414a0e14e07807da814bde72bca, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/0c86cd5fc3174c429d01a6625b355e23, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/60190e610c9b41728de9f3bc36097646] to archive 2023-10-30 14:55:07,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:07,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/f6ce72f8c9124493822a8274400c352e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/f6ce72f8c9124493822a8274400c352e 2023-10-30 14:55:07,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/0c9aa1ac7b584646b47ff20c7b138b3d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/0c9aa1ac7b584646b47ff20c7b138b3d 2023-10-30 14:55:07,704 INFO [Listener at localhost/34621] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-10-30 14:55:07,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/11b63414a0e14e07807da814bde72bca to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/11b63414a0e14e07807da814bde72bca 2023-10-30 14:55:07,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/0c86cd5fc3174c429d01a6625b355e23 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/0c86cd5fc3174c429d01a6625b355e23 2023-10-30 14:55:07,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/60190e610c9b41728de9f3bc36097646 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family2/60190e610c9b41728de9f3bc36097646 2023-10-30 14:55:07,708 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231030c10179cd2f32413ca2065f2fb55830cd_del 2023-10-30 14:55:07,711 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231030d49a6ecc55b84879a554ccaf75c31756_del 2023-10-30 14:55:07,714 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310304440d56f4c794c34a1a3ef2f9965e19b_del 2023-10-30 14:55:07,714 INFO [Listener at localhost/34621] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-10-30 14:55:07,715 DEBUG [Listener at localhost/34621] zookeeper.ReadOnlyZKClient(139): Connect 0x4fcdf184 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:55:07,720 DEBUG [Listener at localhost/34621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c94d3b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:55:07,721 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 14:55:07,721 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 14:55:07,721 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 14:55:08,558 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030a5e8a68abc394f328c8b7298d1926cbd to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231030a5e8a68abc394f328c8b7298d1926cbd 2023-10-30 14:55:08,559 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030ec18a5a64c0f4c1486d581ccb8b5b520 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231030ec18a5a64c0f4c1486d581ccb8b5b520 2023-10-30 14:55:08,559 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310306003105881904d1cb2803f99b333a9a7 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310306003105881904d1cb2803f99b333a9a7 2023-10-30 14:55:08,561 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 14:55:08,561 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 14:55:08,561 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 14:55:08,574 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:55:08,576 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:55:08,582 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 14:55:08,585 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 14:55:08,598 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231030/family1/1854e73e88ad425f9e31a92fd6b7eb14 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-10-30 14:55:08,599 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231030/family1/1854e73e88ad425f9e31a92fd6b7eb14}] 2023-10-30 14:55:08,601 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/family1/21e2c156dd144230bb68e8bb1eaf2fd4 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-10-30 14:55:08,601 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231030/family1/03b066f305b4437e99755e770102c329 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-10-30 14:55:08,602 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/family1/21e2c156dd144230bb68e8bb1eaf2fd4}] 2023-10-30 14:55:08,602 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231030/family1/03b066f305b4437e99755e770102c329}] 2023-10-30 14:55:08,609 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231030/family1/1854e73e88ad425f9e31a92fd6b7eb14 for inclusion in ab337776724960eefa44070b970f617f/family1 2023-10-30 14:55:08,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231030/family1/03b066f305b4437e99755e770102c329 for inclusion in 953b179baa5064d7c5b98a46f266b330/family1 2023-10-30 14:55:08,609 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/family1/21e2c156dd144230bb68e8bb1eaf2fd4 for inclusion in bb974e53dc6d462888c86a0e83d2293c/family1 2023-10-30 14:55:08,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-10-30 14:55:08,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-10-30 14:55:08,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-30 14:55:08,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-10-30 14:55:08,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last=1 2023-10-30 14:55:08,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 953b179baa5064d7c5b98a46f266b330: 2023-10-30 14:55:08,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-30 14:55:08,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for bb974e53dc6d462888c86a0e83d2293c: 2023-10-30 14:55:08,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for ab337776724960eefa44070b970f617f: 2023-10-30 14:55:08,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231030/family1/03b066f305b4437e99755e770102c329 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__ns_testMinorCompaction__9tl4reihm831jlpib14dob14liho0m5lks24mtstt0tr7klfas82qhpfpnd8n8sf/family1/03b066f305b4437e99755e770102c329 2023-10-30 14:55:08,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231030/family1/1854e73e88ad425f9e31a92fd6b7eb14 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__ns_testMinorCompaction__710sfr6rt8lp1gm4lkdcv8gvgrishmai1i20lgn1bqd29e5r569qshnjnqb5711v/family1/1854e73e88ad425f9e31a92fd6b7eb14 2023-10-30 14:55:08,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/family1/21e2c156dd144230bb68e8bb1eaf2fd4 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__ns_testMinorCompaction__tmppla28tmlikjvkpa3p7pra0c3vs5fsm3p359fps0m8eghno7lms6cf1k32kkf7/family1/21e2c156dd144230bb68e8bb1eaf2fd4 2023-10-30 14:55:08,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__ns_testMinorCompaction__9tl4reihm831jlpib14dob14liho0m5lks24mtstt0tr7klfas82qhpfpnd8n8sf/family1/03b066f305b4437e99755e770102c329 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/97803dcca80d46e893ae8f26a9160d48_SeqId_28_ 2023-10-30 14:55:08,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__ns_testMinorCompaction__tmppla28tmlikjvkpa3p7pra0c3vs5fsm3p359fps0m8eghno7lms6cf1k32kkf7/family1/21e2c156dd144230bb68e8bb1eaf2fd4 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/5afb3b8570fe4c748f1f1fb4ae71b1f3_SeqId_28_ 2023-10-30 14:55:08,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__ns_testMinorCompaction__710sfr6rt8lp1gm4lkdcv8gvgrishmai1i20lgn1bqd29e5r569qshnjnqb5711v/family1/1854e73e88ad425f9e31a92fd6b7eb14 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/c92ba43c45b94a21ab1d5bddfa01cbea_SeqId_28_ 2023-10-30 14:55:08,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__ns_testMinorCompaction__9tl4reihm831jlpib14dob14liho0m5lks24mtstt0tr7klfas82qhpfpnd8n8sf/family1/03b066f305b4437e99755e770102c329 into 953b179baa5064d7c5b98a46f266b330/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/97803dcca80d46e893ae8f26a9160d48_SeqId_28_ - updating store file list. 2023-10-30 14:55:08,614 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__ns_testMinorCompaction__tmppla28tmlikjvkpa3p7pra0c3vs5fsm3p359fps0m8eghno7lms6cf1k32kkf7/family1/21e2c156dd144230bb68e8bb1eaf2fd4 into bb974e53dc6d462888c86a0e83d2293c/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/5afb3b8570fe4c748f1f1fb4ae71b1f3_SeqId_28_ - updating store file list. 2023-10-30 14:55:08,615 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__ns_testMinorCompaction__710sfr6rt8lp1gm4lkdcv8gvgrishmai1i20lgn1bqd29e5r569qshnjnqb5711v/family1/1854e73e88ad425f9e31a92fd6b7eb14 into ab337776724960eefa44070b970f617f/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/c92ba43c45b94a21ab1d5bddfa01cbea_SeqId_28_ - updating store file list. 2023-10-30 14:55:08,617 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/c92ba43c45b94a21ab1d5bddfa01cbea_SeqId_28_ into ab337776724960eefa44070b970f617f/family1 2023-10-30 14:55:08,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/97803dcca80d46e893ae8f26a9160d48_SeqId_28_ into 953b179baa5064d7c5b98a46f266b330/family1 2023-10-30 14:55:08,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__ns_testMinorCompaction__9tl4reihm831jlpib14dob14liho0m5lks24mtstt0tr7klfas82qhpfpnd8n8sf/family1/03b066f305b4437e99755e770102c329 into 953b179baa5064d7c5b98a46f266b330/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/family1/97803dcca80d46e893ae8f26a9160d48_SeqId_28_) 2023-10-30 14:55:08,617 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/5afb3b8570fe4c748f1f1fb4ae71b1f3_SeqId_28_ into bb974e53dc6d462888c86a0e83d2293c/family1 2023-10-30 14:55:08,617 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__ns_testMinorCompaction__710sfr6rt8lp1gm4lkdcv8gvgrishmai1i20lgn1bqd29e5r569qshnjnqb5711v/family1/1854e73e88ad425f9e31a92fd6b7eb14 into ab337776724960eefa44070b970f617f/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/family1/c92ba43c45b94a21ab1d5bddfa01cbea_SeqId_28_) 2023-10-30 14:55:08,617 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__ns_testMinorCompaction__tmppla28tmlikjvkpa3p7pra0c3vs5fsm3p359fps0m8eghno7lms6cf1k32kkf7/family1/21e2c156dd144230bb68e8bb1eaf2fd4 into bb974e53dc6d462888c86a0e83d2293c/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/family1/5afb3b8570fe4c748f1f1fb4ae71b1f3_SeqId_28_) 2023-10-30 14:55:08,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__ns_testMinorCompaction__9tl4reihm831jlpib14dob14liho0m5lks24mtstt0tr7klfas82qhpfpnd8n8sf/family1/03b066f305b4437e99755e770102c329 2023-10-30 14:55:08,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__ns_testMinorCompaction__710sfr6rt8lp1gm4lkdcv8gvgrishmai1i20lgn1bqd29e5r569qshnjnqb5711v/family1/1854e73e88ad425f9e31a92fd6b7eb14 2023-10-30 14:55:08,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__ns_testMinorCompaction__tmppla28tmlikjvkpa3p7pra0c3vs5fsm3p359fps0m8eghno7lms6cf1k32kkf7/family1/21e2c156dd144230bb68e8bb1eaf2fd4 2023-10-30 14:55:08,619 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 14:55:08,619 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 14:55:08,619 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 14:55:08,620 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:08,620 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:08,620 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:08,621 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231030466b1476d41b47bf99e6b3ab0b2e6dd2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231030466b1476d41b47bf99e6b3ab0b2e6dd2 2023-10-30 14:55:08,621 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-30 14:55:08,621 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310307f754d4658ae4842b6a04952bcb6697d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310307f754d4658ae4842b6a04952bcb6697d 2023-10-30 14:55:08,621 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023103061eb8c810f3d4bb391279c5348cec233 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023103061eb8c810f3d4bb391279c5348cec233 2023-10-30 14:55:08,621 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231030' 2023-10-30 14:55:08,621 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-30 14:55:08,621 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-30 14:55:08,621 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231030' 2023-10-30 14:55:08,621 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231030' 2023-10-30 14:55:08,621 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 14:55:08,622 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 14:55:08,622 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 14:55:08,622 INFO [Listener at localhost/34621] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-10-30 14:55:08,624 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:55:08,625 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:55:08,628 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:55:08,628 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:55:08,642 INFO [Listener at localhost/34621] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=257 (was 294), OpenFileDescriptor=651 (was 776), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=231 (was 204) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1487 (was 1530) 2023-10-30 14:55:08,656 INFO [Listener at localhost/34621] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=257, OpenFileDescriptor=650, MaxFileDescriptor=60000, SystemLoadAverage=231, ProcessCount=168, AvailableMemoryMB=1486 2023-10-30 14:55:08,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-30 14:55:08,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:08,660 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 14:55:08,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-10-30 14:55:08,661 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 14:55:08,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 14:55:08,662 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0 2023-10-30 14:55:08,662 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0 empty. 2023-10-30 14:55:08,663 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0 2023-10-30 14:55:08,663 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-10-30 14:55:08,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 14:55:08,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 14:55:09,071 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-30 14:55:09,073 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 90c95f38c99863180384d3d8c5d00bc0, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:55:09,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 14:55:09,500 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:55:09,500 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 14:55:09,500 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 90c95f38c99863180384d3d8c5d00bc0, disabling compactions & flushes 2023-10-30 14:55:09,501 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:09,501 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:09,501 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46c98c6b to 127.0.0.1:49804 2023-10-30 14:55:09,501 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. after waiting 0 ms 2023-10-30 14:55:09,501 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:09,501 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:55:09,501 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:09,501 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:09,501 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 14:55:09,501 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4fcdf184 to 127.0.0.1:49804 2023-10-30 14:55:09,501 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:55:09,508 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 14:55:09,508 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7bc887e3 to 127.0.0.1:49804 2023-10-30 14:55:09,508 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:55:09,509 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 14:55:09,510 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698677709510"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677709510"}]},"ts":"1698677709510"} 2023-10-30 14:55:09,511 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 14:55:09,512 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 14:55:09,512 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677709512"}]},"ts":"1698677709512"} 2023-10-30 14:55:09,513 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-10-30 14:55:09,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=90c95f38c99863180384d3d8c5d00bc0, ASSIGN}] 2023-10-30 14:55:09,516 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=90c95f38c99863180384d3d8c5d00bc0, ASSIGN 2023-10-30 14:55:09,517 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=90c95f38c99863180384d3d8c5d00bc0, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:55:09,668 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=90c95f38c99863180384d3d8c5d00bc0, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:09,669 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698677709668"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677709668"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677709668"}]},"ts":"1698677709668"} 2023-10-30 14:55:09,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 90c95f38c99863180384d3d8c5d00bc0, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:55:09,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 14:55:09,825 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:09,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:09,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 90c95f38c99863180384d3d8c5d00bc0, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0.', STARTKEY => '', ENDKEY => ''} 2023-10-30 14:55:09,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 90c95f38c99863180384d3d8c5d00bc0 2023-10-30 14:55:09,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:55:09,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 90c95f38c99863180384d3d8c5d00bc0 2023-10-30 14:55:09,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 90c95f38c99863180384d3d8c5d00bc0 2023-10-30 14:55:09,836 INFO [StoreOpener-90c95f38c99863180384d3d8c5d00bc0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 90c95f38c99863180384d3d8c5d00bc0 2023-10-30 14:55:09,838 DEBUG [StoreOpener-90c95f38c99863180384d3d8c5d00bc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1 2023-10-30 14:55:09,838 DEBUG [StoreOpener-90c95f38c99863180384d3d8c5d00bc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1 2023-10-30 14:55:09,838 INFO [StoreOpener-90c95f38c99863180384d3d8c5d00bc0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 90c95f38c99863180384d3d8c5d00bc0 columnFamilyName family1 2023-10-30 14:55:09,840 INFO [StoreOpener-90c95f38c99863180384d3d8c5d00bc0-1] regionserver.HStore(310): Store=90c95f38c99863180384d3d8c5d00bc0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:55:09,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0 2023-10-30 14:55:09,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0 2023-10-30 14:55:09,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 90c95f38c99863180384d3d8c5d00bc0 2023-10-30 14:55:09,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:55:09,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 90c95f38c99863180384d3d8c5d00bc0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69004316, jitterRate=0.028244435787200928}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 14:55:09,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:09,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0., pid=114, masterSystemTime=1698677709825 2023-10-30 14:55:09,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:09,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:09,847 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=90c95f38c99863180384d3d8c5d00bc0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:09,847 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698677709847"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677709847"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677709847"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677709847"}]},"ts":"1698677709847"} 2023-10-30 14:55:09,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-10-30 14:55:09,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 90c95f38c99863180384d3d8c5d00bc0, server=jenkins-hbase20.apache.org,36359,1698677568317 in 177 msec 2023-10-30 14:55:09,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-10-30 14:55:09,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=90c95f38c99863180384d3d8c5d00bc0, ASSIGN in 335 msec 2023-10-30 14:55:09,850 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 14:55:09,850 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677709850"}]},"ts":"1698677709850"} 2023-10-30 14:55:09,851 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-10-30 14:55:09,853 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 14:55:09,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1950 sec 2023-10-30 14:55:10,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 14:55:10,772 INFO [Listener at localhost/34621] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-10-30 14:55:10,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:55:10,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:10,796 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:10,796 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:10,796 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:55:10,796 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:55:10,797 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:10,797 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:10,797 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:10,797 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:10,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:10,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:10,798 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:10,798 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:55:10,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:10,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:10,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:55:10,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:10,798 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:10,799 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:10,799 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:55:10,799 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:10,799 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:55:10,799 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:55:10,799 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:55:10,799 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:10,799 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. started... 2023-10-30 14:55:10,800 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90c95f38c99863180384d3d8c5d00bc0 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 14:55:11,225 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c05445a7fcab425ca4ed2bc3190b5e69 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130c05445a7fcab425ca4ed2bc3190b5e69 2023-10-30 14:55:11,630 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/d729ddf3cc3d47e6938ee6ede48358bc 2023-10-30 14:55:11,642 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/d729ddf3cc3d47e6938ee6ede48358bc as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/d729ddf3cc3d47e6938ee6ede48358bc 2023-10-30 14:55:11,647 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/d729ddf3cc3d47e6938ee6ede48358bc, entries=1000, sequenceid=5, filesize=166.0 K 2023-10-30 14:55:11,648 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 90c95f38c99863180384d3d8c5d00bc0 in 848ms, sequenceid=5, compaction requested=false 2023-10-30 14:55:11,648 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:11,649 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:11,649 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:11,649 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:55:11,649 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:55:11,649 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:11,649 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:55:11,649 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:55:11,651 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,651 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:11,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:11,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:11,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:11,651 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,651 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:55:11,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:11,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:11,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:55:11,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ab1d09d[Count = 0] remaining members to acquire global barrier 2023-10-30 14:55:11,654 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:55:11,654 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,655 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,655 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:55:11,655 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:55:11,655 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:55:11,655 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:11,655 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:55:11,657 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:55:11,657 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:11,657 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:11,657 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:55:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:11,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:11,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:11,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:11,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:55:11,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:55:11,661 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:55:11,661 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:55:11,661 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:55:11,661 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,661 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:55:11,670 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,670 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:11,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,670 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:11,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:11,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:11,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:11,671 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:11,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:11,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:11,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,672 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:11,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:11,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:11,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:11,673 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:11,673 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:11,673 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:11,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:11,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:55:11,673 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:11,673 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,673 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:11,674 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:11,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 14:55:11,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:11,674 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:55:11,674 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,674 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:55:11,674 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,674 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:11,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:11,774 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:55:11,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:55:11,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:55:11,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:55:11,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,781 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:11,781 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:11,781 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:55:11,781 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:55:11,782 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,782 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,782 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:11,782 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:11,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:11,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:11,783 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:11,783 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:55:11,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,783 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:55:11,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,784 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,784 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:55:11,784 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:11,784 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:55:11,784 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:11,784 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:55:11,784 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:55:11,784 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:55:11,784 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:11,784 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. started... 2023-10-30 14:55:11,784 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90c95f38c99863180384d3d8c5d00bc0 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 14:55:12,195 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e25e26b8e2104881b0a23288c14b0729 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128e25e26b8e2104881b0a23288c14b0729 2023-10-30 14:55:12,600 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/3d22e737a81f492db15c502c18bc4cd4 2023-10-30 14:55:12,605 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/3d22e737a81f492db15c502c18bc4cd4 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/3d22e737a81f492db15c502c18bc4cd4 2023-10-30 14:55:12,610 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/3d22e737a81f492db15c502c18bc4cd4, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 14:55:12,611 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 90c95f38c99863180384d3d8c5d00bc0 in 827ms, sequenceid=9, compaction requested=false 2023-10-30 14:55:12,611 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:12,611 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:12,611 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:55:12,612 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:55:12,612 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:12,612 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:55:12,612 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:55:12,613 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:12,613 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:12,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:12,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:12,614 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,614 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:55:12,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:12,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:12,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:12,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:55:12,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5987fdde[Count = 0] remaining members to acquire global barrier 2023-10-30 14:55:12,617 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:55:12,617 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,617 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,618 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:55:12,618 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:55:12,618 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:55:12,618 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:12,618 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:55:12,619 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:55:12,619 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:12,619 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:12,619 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:55:12,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:12,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:12,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:12,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:12,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:12,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:12,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:12,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:12,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:55:12,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:55:12,623 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:55:12,623 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:55:12,623 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:55:12,623 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,623 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:55:12,625 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,625 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:12,625 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:12,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:12,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,626 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:12,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:12,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:12,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:12,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:12,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,627 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:12,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:12,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:12,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:12,646 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:12,646 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:12,646 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,646 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 14:55:12,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:12,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:12,646 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:12,646 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:12,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:12,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:55:12,646 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:12,647 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:12,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:12,647 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,648 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:55:12,648 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:55:12,648 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,748 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:55:12,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:55:12,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:55:12,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:55:12,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,763 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:12,763 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:12,764 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:55:12,764 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:55:12,764 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,764 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,765 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:12,765 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:12,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:12,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:12,766 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:12,766 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:55:12,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:55:12,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,767 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,768 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:55:12,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:12,768 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:55:12,768 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:12,768 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:55:12,768 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:55:12,768 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:55:12,768 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:12,768 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. started... 2023-10-30 14:55:12,768 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90c95f38c99863180384d3d8c5d00bc0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:55:12,783 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120109fcde47f39b4ed4b1cce9301b54dd01 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120109fcde47f39b4ed4b1cce9301b54dd01 2023-10-30 14:55:13,191 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/026f53cf24a04c8bb9fae74fc8081cab 2023-10-30 14:55:13,201 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/026f53cf24a04c8bb9fae74fc8081cab as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/026f53cf24a04c8bb9fae74fc8081cab 2023-10-30 14:55:13,205 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/026f53cf24a04c8bb9fae74fc8081cab, entries=1, sequenceid=13, filesize=4.9 K 2023-10-30 14:55:13,206 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 90c95f38c99863180384d3d8c5d00bc0 in 438ms, sequenceid=13, compaction requested=true 2023-10-30 14:55:13,207 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:13,207 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:13,207 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:55:13,207 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:55:13,207 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:13,207 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:55:13,207 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:55:13,208 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,208 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:13,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:13,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:13,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:13,209 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,209 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:55:13,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:13,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:13,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:13,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:13,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:55:13,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@799cdcf0[Count = 0] remaining members to acquire global barrier 2023-10-30 14:55:13,210 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:55:13,211 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,211 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,212 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:55:13,212 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:55:13,212 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:55:13,212 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:13,212 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:55:13,213 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:55:13,213 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:13,213 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:55:13,213 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:13,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:13,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:13,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:13,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:13,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:13,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:13,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:13,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:13,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:55:13,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:55:13,217 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:55:13,217 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:55:13,217 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:55:13,217 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,217 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:55:13,219 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,219 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,219 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:13,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:13,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:13,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:13,220 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:13,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:13,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:13,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:13,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,222 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:13,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:13,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:13,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:13,224 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:13,224 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,225 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,225 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:13,225 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,225 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:13,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 14:55:13,224 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:13,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:55:13,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:13,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:13,225 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,225 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:13,225 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:13,225 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:55:13,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:13,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:13,226 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:55:13,326 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:55:13,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:55:13,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:55:13,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:55:13,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,339 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:13,339 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:13,339 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:55:13,339 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:55:13,340 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,340 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,341 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:13,341 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:13,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:13,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:13,342 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:13,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,342 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:55:13,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:55:13,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,344 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,344 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:55:13,344 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:13,344 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:55:13,344 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:13,344 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:55:13,344 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:55:13,345 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:55:13,345 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:13,345 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. started... 2023-10-30 14:55:13,345 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90c95f38c99863180384d3d8c5d00bc0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:55:13,767 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120507523841ee8640a09c2117fde4c55b91 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120507523841ee8640a09c2117fde4c55b91 2023-10-30 14:55:14,173 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/8671a9d610ef423daf4d76800320495b 2023-10-30 14:55:14,185 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/8671a9d610ef423daf4d76800320495b as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/8671a9d610ef423daf4d76800320495b 2023-10-30 14:55:14,190 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/8671a9d610ef423daf4d76800320495b, entries=1, sequenceid=17, filesize=4.9 K 2023-10-30 14:55:14,190 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 90c95f38c99863180384d3d8c5d00bc0 in 845ms, sequenceid=17, compaction requested=true 2023-10-30 14:55:14,190 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:14,191 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:14,191 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:55:14,191 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:55:14,191 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,191 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:55:14,191 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:55:14,192 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,192 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:14,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:14,192 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,192 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:55:14,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:14,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:14,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:14,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:55:14,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39d8cbf4[Count = 0] remaining members to acquire global barrier 2023-10-30 14:55:14,194 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:55:14,194 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,194 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,195 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:55:14,195 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:55:14,195 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:55:14,195 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,195 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:55:14,195 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:55:14,195 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,196 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:14,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:14,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:14,196 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:55:14,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:14,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:14,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:14,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:55:14,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:55:14,197 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:55:14,197 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:55:14,197 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:55:14,197 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,197 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:55:14,198 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,198 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:14,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:14,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,198 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:14,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:14,199 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:14,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:14,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:14,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,200 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:14,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,201 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,201 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:14,201 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,201 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:14,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:14,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:14,201 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:14,201 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:14,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:55:14,201 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:14,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:14,201 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,202 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,202 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,202 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:55:14,202 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:55:14,302 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:55:14,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:55:14,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:55:14,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:55:14,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,313 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:14,313 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:14,313 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:55:14,313 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:55:14,314 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,314 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,315 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:14,316 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:14,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:14,316 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,316 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:55:14,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:55:14,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,318 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,318 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:55:14,319 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,319 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:55:14,319 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:14,319 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:55:14,319 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:55:14,319 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:55:14,319 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:14,319 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. started... 2023-10-30 14:55:14,319 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90c95f38c99863180384d3d8c5d00bc0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:55:14,338 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228ad3319913a024fc58f4b13d920406d0f to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228ad3319913a024fc58f4b13d920406d0f 2023-10-30 14:55:14,747 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/c8328e51028444e7a21baa2b3feba494 2023-10-30 14:55:14,757 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/c8328e51028444e7a21baa2b3feba494 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/c8328e51028444e7a21baa2b3feba494 2023-10-30 14:55:14,761 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/c8328e51028444e7a21baa2b3feba494, entries=1, sequenceid=21, filesize=4.9 K 2023-10-30 14:55:14,762 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 90c95f38c99863180384d3d8c5d00bc0 in 443ms, sequenceid=21, compaction requested=true 2023-10-30 14:55:14,762 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:14,762 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:14,762 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:55:14,762 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:55:14,762 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,762 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:55:14,762 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:55:14,763 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,763 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:14,764 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,764 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:55:14,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:14,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:14,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:14,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:55:14,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d59c16a[Count = 0] remaining members to acquire global barrier 2023-10-30 14:55:14,765 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:55:14,765 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,766 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,766 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:55:14,766 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:55:14,766 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:55:14,767 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,767 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:55:14,768 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:55:14,768 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,768 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:14,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:14,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:14,768 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:55:14,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:14,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:14,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:14,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:55:14,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:55:14,771 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:55:14,771 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:55:14,771 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:55:14,771 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,771 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:55:14,773 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,773 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:14,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:14,773 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:14,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:14,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:14,774 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:14,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:14,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,775 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:14,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,777 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,777 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,777 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:14,777 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:14,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:55:14,777 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:14,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:14,777 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:14,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:14,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 14:55:14,777 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:55:14,777 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,777 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:55:14,777 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,777 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:14,777 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:14,877 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:55:14,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:55:14,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:55:14,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:55:14,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,883 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:14,883 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:14,883 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:55:14,883 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:55:14,884 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,884 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,884 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:14,884 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:14,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:14,885 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:14,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,885 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:55:14,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:55:14,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,886 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,886 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:55:14,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:14,886 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:55:14,886 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:14,886 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:55:14,886 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:55:14,886 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:55:14,886 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:14,886 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. started... 2023-10-30 14:55:14,886 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90c95f38c99863180384d3d8c5d00bc0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:55:15,298 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f83fcaf0575741ffbeddb6eaa9c78e8f to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231f83fcaf0575741ffbeddb6eaa9c78e8f 2023-10-30 14:55:15,375 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 14:55:15,704 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/510d355938a04a35921ba1b3acea41e0 2023-10-30 14:55:15,710 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/510d355938a04a35921ba1b3acea41e0 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/510d355938a04a35921ba1b3acea41e0 2023-10-30 14:55:15,714 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/510d355938a04a35921ba1b3acea41e0, entries=1, sequenceid=25, filesize=4.9 K 2023-10-30 14:55:15,715 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 90c95f38c99863180384d3d8c5d00bc0 in 829ms, sequenceid=25, compaction requested=true 2023-10-30 14:55:15,715 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:15,715 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:15,716 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:55:15,716 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:55:15,716 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:15,716 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:55:15,716 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:55:15,717 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,717 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:15,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:15,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:15,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:15,717 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,718 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:55:15,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:15,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:15,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:15,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:15,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:55:15,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b56b412[Count = 0] remaining members to acquire global barrier 2023-10-30 14:55:15,720 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:55:15,720 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,721 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,721 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:55:15,721 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:55:15,721 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:55:15,721 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:15,721 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:55:15,722 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:55:15,723 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:15,723 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:15,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:15,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:15,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:15,723 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:55:15,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:15,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:15,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:15,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:15,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:15,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:55:15,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:55:15,727 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:55:15,727 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:55:15,727 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:55:15,727 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,727 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:55:15,728 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,728 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:15,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:15,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,729 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:15,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:15,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:15,730 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:15,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:15,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:15,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,731 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:15,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:15,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:15,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:15,732 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:15,732 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:15,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:15,732 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,732 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:15,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:15,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 14:55:15,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:15,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:55:15,732 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:15,732 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,732 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:15,732 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,732 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,732 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,733 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:55:15,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:15,733 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:55:15,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:15,833 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:55:15,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:55:15,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:55:15,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:55:15,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,839 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:15,839 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:15,839 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:55:15,839 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:55:15,839 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,839 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,840 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:15,840 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:15,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:15,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:15,841 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:15,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,841 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:55:15,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:55:15,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,841 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,841 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:55:15,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:15,842 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:55:15,842 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:15,842 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:55:15,842 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:55:15,842 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:55:15,842 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:15,842 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. started... 2023-10-30 14:55:15,842 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90c95f38c99863180384d3d8c5d00bc0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:55:16,257 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601019e76fcf244d148f0a8b06d297d28a7e3 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601019e76fcf244d148f0a8b06d297d28a7e3 2023-10-30 14:55:16,664 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/12554bd4f49446baa2deda2663a7ac57 2023-10-30 14:55:16,668 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/12554bd4f49446baa2deda2663a7ac57 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/12554bd4f49446baa2deda2663a7ac57 2023-10-30 14:55:16,671 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/12554bd4f49446baa2deda2663a7ac57, entries=1, sequenceid=29, filesize=4.9 K 2023-10-30 14:55:16,672 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 90c95f38c99863180384d3d8c5d00bc0 in 830ms, sequenceid=29, compaction requested=true 2023-10-30 14:55:16,672 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:16,672 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:16,672 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:55:16,672 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:55:16,672 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:16,672 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:55:16,672 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:55:16,673 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,673 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:16,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:16,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:16,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:16,673 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,673 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:55:16,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:16,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:16,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:16,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:16,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:55:16,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74328ed4[Count = 0] remaining members to acquire global barrier 2023-10-30 14:55:16,674 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:55:16,675 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,675 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,675 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:55:16,675 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:55:16,675 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:55:16,675 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:16,675 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:55:16,676 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:55:16,676 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:16,676 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:16,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:16,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:16,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:16,676 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:55:16,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:16,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:16,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:16,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:16,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:16,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:55:16,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:55:16,678 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:55:16,678 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:55:16,678 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:55:16,678 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,678 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:55:16,679 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,679 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:16,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,679 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:16,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:16,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:16,680 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:16,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:16,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:16,681 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:16,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:16,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:16,682 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:16,682 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:16,682 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:16,682 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:16,682 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:16,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:16,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:55:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:16,682 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,682 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:16,682 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,682 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,682 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,682 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:55:16,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:16,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:16,683 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:55:16,783 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:55:16,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:55:16,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:55:16,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:55:16,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,789 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:16,789 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:16,789 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:55:16,789 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:55:16,790 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,790 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,790 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:16,790 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:16,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:16,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:16,791 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:16,791 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:55:16,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:55:16,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,792 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,792 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:55:16,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:16,792 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:55:16,792 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:16,792 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:55:16,792 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:55:16,792 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:55:16,792 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:16,792 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. started... 2023-10-30 14:55:16,792 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90c95f38c99863180384d3d8c5d00bc0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:55:17,203 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d3379f5232c24e79a5eae373ae3d2d87 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103d3379f5232c24e79a5eae373ae3d2d87 2023-10-30 14:55:17,210 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/bd059c228189488dbb1a698de9a6f8a9 2023-10-30 14:55:17,213 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/bd059c228189488dbb1a698de9a6f8a9 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/bd059c228189488dbb1a698de9a6f8a9 2023-10-30 14:55:17,216 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/bd059c228189488dbb1a698de9a6f8a9, entries=1, sequenceid=33, filesize=4.9 K 2023-10-30 14:55:17,217 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 90c95f38c99863180384d3d8c5d00bc0 in 425ms, sequenceid=33, compaction requested=true 2023-10-30 14:55:17,217 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:17,217 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:17,217 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:55:17,217 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:55:17,217 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:17,217 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:55:17,217 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:55:17,220 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:17,220 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:17,220 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,220 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:55:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:17,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:55:17,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b4a7ccd[Count = 0] remaining members to acquire global barrier 2023-10-30 14:55:17,221 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:55:17,221 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,222 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,222 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:55:17,222 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:17,222 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:55:17,222 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:55:17,222 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:55:17,224 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:17,224 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:55:17,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:17,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:17,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:17,224 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:17,224 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:55:17,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:17,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:17,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:17,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:17,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:17,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:55:17,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:55:17,227 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:55:17,227 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:55:17,227 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:55:17,227 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,227 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:55:17,228 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,228 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:17,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:17,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,228 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:17,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:17,228 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:17,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:17,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:17,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:17,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:17,229 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:17,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:17,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:17,231 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:17,231 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:17,231 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:17,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:17,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:55:17,231 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:17,231 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,231 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:17,232 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:17,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:17,232 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,232 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:55:17,232 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,232 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:55:17,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:17,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:17,232 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,332 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:55:17,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:55:17,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:55:17,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:55:17,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,342 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:17,342 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:17,342 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:55:17,342 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:55:17,343 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,343 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,344 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:17,344 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:17,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:17,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:17,345 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:17,345 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:55:17,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:55:17,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,347 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,348 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:55:17,348 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:17,348 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:55:17,348 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:17,348 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:55:17,348 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:55:17,348 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:55:17,348 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:17,349 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. started... 2023-10-30 14:55:17,349 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90c95f38c99863180384d3d8c5d00bc0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:55:17,770 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090754190bcfc8114965b61f00b6de9823a9 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015090754190bcfc8114965b61f00b6de9823a9 2023-10-30 14:55:18,178 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/4fb138e8b0c84f0b80070a3513a53438 2023-10-30 14:55:18,190 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/4fb138e8b0c84f0b80070a3513a53438 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/4fb138e8b0c84f0b80070a3513a53438 2023-10-30 14:55:18,195 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/4fb138e8b0c84f0b80070a3513a53438, entries=1, sequenceid=37, filesize=4.9 K 2023-10-30 14:55:18,196 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 90c95f38c99863180384d3d8c5d00bc0 in 847ms, sequenceid=37, compaction requested=true 2023-10-30 14:55:18,196 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:18,196 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:18,197 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:55:18,197 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:55:18,197 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,197 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:55:18,197 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:55:18,198 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,198 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:18,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:18,199 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,199 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:55:18,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:18,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:18,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:18,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:55:18,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@485bbe5f[Count = 0] remaining members to acquire global barrier 2023-10-30 14:55:18,201 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:55:18,201 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,202 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,202 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:55:18,202 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:55:18,202 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:55:18,202 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,202 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:55:18,203 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:55:18,203 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,203 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:18,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:18,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:18,203 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:55:18,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:18,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:18,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:18,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:55:18,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:55:18,206 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:55:18,206 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:55:18,206 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:55:18,207 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,207 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:55:18,208 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,208 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:18,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:18,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,208 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:18,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:18,208 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,210 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:18,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,212 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,212 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:18,212 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,212 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:18,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:18,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:55:18,212 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,212 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:18,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:18,213 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:55:18,213 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,213 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 14:55:18,213 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,213 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:55:18,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:18,213 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,214 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:18,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:18,314 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:55:18,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:55:18,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:55:18,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 14:55:18,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,327 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:18,327 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:18,328 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 14:55:18,328 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 14:55:18,328 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,328 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,329 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,329 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:18,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:18,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:18,330 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,330 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:55:18,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:55:18,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,331 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,332 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 14:55:18,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,332 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 14:55:18,332 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:18,332 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 14:55:18,332 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 14:55:18,332 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:55:18,332 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:18,332 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. started... 2023-10-30 14:55:18,332 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90c95f38c99863180384d3d8c5d00bc0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 14:55:18,349 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b7f67d1fcb7c4975973a2b2828d07519 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120b7f67d1fcb7c4975973a2b2828d07519 2023-10-30 14:55:18,756 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/70b8ac1884f24df9a7b7e5215371b165 2023-10-30 14:55:18,766 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/70b8ac1884f24df9a7b7e5215371b165 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/70b8ac1884f24df9a7b7e5215371b165 2023-10-30 14:55:18,773 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/70b8ac1884f24df9a7b7e5215371b165, entries=1, sequenceid=41, filesize=4.9 K 2023-10-30 14:55:18,774 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 90c95f38c99863180384d3d8c5d00bc0 in 442ms, sequenceid=41, compaction requested=true 2023-10-30 14:55:18,774 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:18,775 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:18,775 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 14:55:18,775 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 14:55:18,775 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,775 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 14:55:18,775 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 14:55:18,776 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,776 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:18,777 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,777 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:55:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:18,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:18,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:18,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 14:55:18,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16f36562[Count = 0] remaining members to acquire global barrier 2023-10-30 14:55:18,780 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 14:55:18,780 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,781 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,781 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 14:55:18,781 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 14:55:18,781 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:55:18,781 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,781 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:55:18,782 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 14:55:18,782 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,782 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:18,783 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 14:55:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:18,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:18,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:55:18,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 14:55:18,788 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 14:55:18,788 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:55:18,788 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:55:18,788 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,788 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:55:18,797 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,797 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,797 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:18,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:18,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:18,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:18,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:18,798 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:18,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:18,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,801 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:18,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,805 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,805 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:18,805 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,806 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 14:55:18,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:55:18,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:18,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:18,806 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:18,806 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:18,806 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 14:55:18,807 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:55:18,806 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:18,807 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,807 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,807 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:18,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:18,907 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:55:18,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:55:18,912 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43911] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-10-30 14:55:18,915 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 14:55:18,916 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 14:55:18,917 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698678318917 2023-10-30 14:55:18,917 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:55:18,918 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 14:55:18,920 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-10-30 14:55:18,920 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 14:55:18,921 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] zookeeper.ReadOnlyZKClient(139): Connect 0x274bfe34 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:55:18,926 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@545abcfa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:55:18,926 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 14:55:19,760 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b7bcb6c4dfd44db0b8dd2f2dd3726e9f to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103b7bcb6c4dfd44db0b8dd2f2dd3726e9f 2023-10-30 14:55:19,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 14:55:19,779 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:55:19,781 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:55:19,788 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 14:55:19,789 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 14:55:19,797 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/9f27047bd19741c1bc743f2f21757671 first=Optional[r5] last=Optional[r6] 2023-10-30 14:55:19,797 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/9f27047bd19741c1bc743f2f21757671}] 2023-10-30 14:55:19,804 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/9f27047bd19741c1bc743f2f21757671 for inclusion in 90c95f38c99863180384d3d8c5d00bc0/family1 2023-10-30 14:55:19,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-10-30 14:55:19,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:55:19,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:19,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/9f27047bd19741c1bc743f2f21757671 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f9vvoj8nh894u00206a4kinopkvhhd5js21jqfribqhk6s1is4pbn20885v7bc7/family1/9f27047bd19741c1bc743f2f21757671 2023-10-30 14:55:19,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f9vvoj8nh894u00206a4kinopkvhhd5js21jqfribqhk6s1is4pbn20885v7bc7/family1/9f27047bd19741c1bc743f2f21757671 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/b380261ae456456a899ee337c3ffdfb4_SeqId_44_ 2023-10-30 14:55:19,811 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f9vvoj8nh894u00206a4kinopkvhhd5js21jqfribqhk6s1is4pbn20885v7bc7/family1/9f27047bd19741c1bc743f2f21757671 into 90c95f38c99863180384d3d8c5d00bc0/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/b380261ae456456a899ee337c3ffdfb4_SeqId_44_ - updating store file list. 2023-10-30 14:55:19,815 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/b380261ae456456a899ee337c3ffdfb4_SeqId_44_ into 90c95f38c99863180384d3d8c5d00bc0/family1 2023-10-30 14:55:19,815 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f9vvoj8nh894u00206a4kinopkvhhd5js21jqfribqhk6s1is4pbn20885v7bc7/family1/9f27047bd19741c1bc743f2f21757671 into 90c95f38c99863180384d3d8c5d00bc0/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/b380261ae456456a899ee337c3ffdfb4_SeqId_44_) 2023-10-30 14:55:19,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f9vvoj8nh894u00206a4kinopkvhhd5js21jqfribqhk6s1is4pbn20885v7bc7/family1/9f27047bd19741c1bc743f2f21757671 2023-10-30 14:55:19,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 14:55:19,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 14:55:19,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(1912): 90c95f38c99863180384d3d8c5d00bc0/family1 is initiating minor compaction 2023-10-30 14:55:19,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@69715e66; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-30 14:55:19,819 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 90c95f38c99863180384d3d8c5d00bc0/family1 in testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:19,819 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/3d22e737a81f492db15c502c18bc4cd4, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/026f53cf24a04c8bb9fae74fc8081cab, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/8671a9d610ef423daf4d76800320495b, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/c8328e51028444e7a21baa2b3feba494, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/510d355938a04a35921ba1b3acea41e0, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/12554bd4f49446baa2deda2663a7ac57, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/bd059c228189488dbb1a698de9a6f8a9, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/4fb138e8b0c84f0b80070a3513a53438, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/70b8ac1884f24df9a7b7e5215371b165, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/b380261ae456456a899ee337c3ffdfb4_SeqId_44_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp, totalSize=49.7 K 2023-10-30 14:55:19,819 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting 3d22e737a81f492db15c502c18bc4cd4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 14:55:19,819 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting 026f53cf24a04c8bb9fae74fc8081cab, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 14:55:19,819 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting 8671a9d610ef423daf4d76800320495b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 14:55:19,819 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting c8328e51028444e7a21baa2b3feba494, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 14:55:19,820 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting 510d355938a04a35921ba1b3acea41e0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 14:55:19,820 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting 12554bd4f49446baa2deda2663a7ac57, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 14:55:19,820 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting bd059c228189488dbb1a698de9a6f8a9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 14:55:19,820 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting 4fb138e8b0c84f0b80070a3513a53438, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 14:55:19,820 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting 70b8ac1884f24df9a7b7e5215371b165, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 14:55:19,820 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] compactions.Compactor(207): Compacting b380261ae456456a899ee337c3ffdfb4_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 14:55:19,821 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 14:55:19,821 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:19,823 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601019e76fcf244d148f0a8b06d297d28a7e3 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601019e76fcf244d148f0a8b06d297d28a7e3 2023-10-30 14:55:19,824 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103d3379f5232c24e79a5eae373ae3d2d87 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103d3379f5232c24e79a5eae373ae3d2d87 2023-10-30 14:55:19,824 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-10-30 14:55:19,824 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-10-30 14:55:19,824 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 14:55:19,824 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 14:55:19,863 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] throttle.PressureAwareThroughputController(145): 90c95f38c99863180384d3d8c5d00bc0#family1#compaction#166 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:55:20,288 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/a235934632284a27934f08b43c703e97 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/a235934632284a27934f08b43c703e97 2023-10-30 14:55:20,293 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 90c95f38c99863180384d3d8c5d00bc0/family1 of 90c95f38c99863180384d3d8c5d00bc0 into a235934632284a27934f08b43c703e97(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:55:20,293 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:20,293 INFO [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698677719819; duration=0sec 2023-10-30 14:55:20,294 DEBUG [RS:0;jenkins-hbase20:36359-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:55:20,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/3d22e737a81f492db15c502c18bc4cd4, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/026f53cf24a04c8bb9fae74fc8081cab, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/8671a9d610ef423daf4d76800320495b, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/c8328e51028444e7a21baa2b3feba494, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/510d355938a04a35921ba1b3acea41e0, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/12554bd4f49446baa2deda2663a7ac57, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/bd059c228189488dbb1a698de9a6f8a9, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/4fb138e8b0c84f0b80070a3513a53438, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/70b8ac1884f24df9a7b7e5215371b165, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/b380261ae456456a899ee337c3ffdfb4_SeqId_44_] to archive 2023-10-30 14:55:20,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:20,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/3d22e737a81f492db15c502c18bc4cd4 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/3d22e737a81f492db15c502c18bc4cd4 2023-10-30 14:55:20,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/026f53cf24a04c8bb9fae74fc8081cab to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/026f53cf24a04c8bb9fae74fc8081cab 2023-10-30 14:55:20,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/8671a9d610ef423daf4d76800320495b to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/8671a9d610ef423daf4d76800320495b 2023-10-30 14:55:20,313 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/c8328e51028444e7a21baa2b3feba494 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/c8328e51028444e7a21baa2b3feba494 2023-10-30 14:55:20,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/510d355938a04a35921ba1b3acea41e0 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/510d355938a04a35921ba1b3acea41e0 2023-10-30 14:55:20,316 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/12554bd4f49446baa2deda2663a7ac57 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/12554bd4f49446baa2deda2663a7ac57 2023-10-30 14:55:20,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/bd059c228189488dbb1a698de9a6f8a9 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/bd059c228189488dbb1a698de9a6f8a9 2023-10-30 14:55:20,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/4fb138e8b0c84f0b80070a3513a53438 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/4fb138e8b0c84f0b80070a3513a53438 2023-10-30 14:55:20,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/70b8ac1884f24df9a7b7e5215371b165 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/70b8ac1884f24df9a7b7e5215371b165 2023-10-30 14:55:20,322 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/b380261ae456456a899ee337c3ffdfb4_SeqId_44_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/b380261ae456456a899ee337c3ffdfb4_SeqId_44_ 2023-10-30 14:55:20,691 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231bcbb56b2f90a4aa6bc81eb7a21769154 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231bcbb56b2f90a4aa6bc81eb7a21769154 2023-10-30 14:55:20,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 14:55:20,712 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/7fe60c5770b2415eab41aaa18b2f208a first=Optional[r1] last=Optional[r4] 2023-10-30 14:55:20,713 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/7fe60c5770b2415eab41aaa18b2f208a}] 2023-10-30 14:55:20,715 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/7fe60c5770b2415eab41aaa18b2f208a for inclusion in 90c95f38c99863180384d3d8c5d00bc0/family1 2023-10-30 14:55:20,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-10-30 14:55:20,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:55:20,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:20,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/7fe60c5770b2415eab41aaa18b2f208a to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithMonthlyPolicy__n9pghavr5otljo7btak7g0m9m1kvvjh9hf26hs7lee88oqjubtnp5um6svn32ksm/family1/7fe60c5770b2415eab41aaa18b2f208a 2023-10-30 14:55:20,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithMonthlyPolicy__n9pghavr5otljo7btak7g0m9m1kvvjh9hf26hs7lee88oqjubtnp5um6svn32ksm/family1/7fe60c5770b2415eab41aaa18b2f208a as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/81d0434210ca4e82aaa9bdf74b4279fa_SeqId_47_ 2023-10-30 14:55:20,721 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithMonthlyPolicy__n9pghavr5otljo7btak7g0m9m1kvvjh9hf26hs7lee88oqjubtnp5um6svn32ksm/family1/7fe60c5770b2415eab41aaa18b2f208a into 90c95f38c99863180384d3d8c5d00bc0/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/81d0434210ca4e82aaa9bdf74b4279fa_SeqId_47_ - updating store file list. 2023-10-30 14:55:20,725 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/81d0434210ca4e82aaa9bdf74b4279fa_SeqId_47_ into 90c95f38c99863180384d3d8c5d00bc0/family1 2023-10-30 14:55:20,726 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithMonthlyPolicy__n9pghavr5otljo7btak7g0m9m1kvvjh9hf26hs7lee88oqjubtnp5um6svn32ksm/family1/7fe60c5770b2415eab41aaa18b2f208a into 90c95f38c99863180384d3d8c5d00bc0/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/81d0434210ca4e82aaa9bdf74b4279fa_SeqId_47_) 2023-10-30 14:55:20,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithMonthlyPolicy__n9pghavr5otljo7btak7g0m9m1kvvjh9hf26hs7lee88oqjubtnp5um6svn32ksm/family1/7fe60c5770b2415eab41aaa18b2f208a 2023-10-30 14:55:20,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 14:55:20,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 14:55:20,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(1912): 90c95f38c99863180384d3d8c5d00bc0/family1 is initiating minor compaction (all files) 2023-10-30 14:55:20,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@779f2e11; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:55:20,728 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 90c95f38c99863180384d3d8c5d00bc0/family1 in testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:20,728 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/d729ddf3cc3d47e6938ee6ede48358bc, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/a235934632284a27934f08b43c703e97, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/81d0434210ca4e82aaa9bdf74b4279fa_SeqId_47_] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp, totalSize=178.1 K 2023-10-30 14:55:20,728 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting d729ddf3cc3d47e6938ee6ede48358bc, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878852219 2023-10-30 14:55:20,729 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting a235934632284a27934f08b43c703e97, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621252219 2023-10-30 14:55:20,729 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] compactions.Compactor(207): Compacting 81d0434210ca4e82aaa9bdf74b4279fa_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965252219 2023-10-30 14:55:20,730 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 14:55:20,730 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:20,732 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120109fcde47f39b4ed4b1cce9301b54dd01 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120109fcde47f39b4ed4b1cce9301b54dd01 2023-10-30 14:55:20,733 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120507523841ee8640a09c2117fde4c55b91 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120507523841ee8640a09c2117fde4c55b91 2023-10-30 14:55:20,734 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228ad3319913a024fc58f4b13d920406d0f to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228ad3319913a024fc58f4b13d920406d0f 2023-10-30 14:55:20,736 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231f83fcaf0575741ffbeddb6eaa9c78e8f to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231f83fcaf0575741ffbeddb6eaa9c78e8f 2023-10-30 14:55:20,736 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-10-30 14:55:20,736 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-10-30 14:55:20,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 14:55:20,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 14:55:20,745 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] throttle.PressureAwareThroughputController(145): 90c95f38c99863180384d3d8c5d00bc0#family1#compaction#167 average throughput is 19.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:55:21,168 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511309c276e4fd2d641eea472e31d9c3c4559 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511309c276e4fd2d641eea472e31d9c3c4559 2023-10-30 14:55:21,169 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 14:55:21,190 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1c0cb41c0f414904a731117edb63506b first=Optional[r00] last=Optional[r8] 2023-10-30 14:55:21,191 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1c0cb41c0f414904a731117edb63506b}] 2023-10-30 14:55:21,193 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1c0cb41c0f414904a731117edb63506b for inclusion in 90c95f38c99863180384d3d8c5d00bc0/family1 2023-10-30 14:55:21,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-10-30 14:55:21,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 14:55:21,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:21,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1c0cb41c0f414904a731117edb63506b to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ce3d142d4ba9p6k0aqagbc0qf35qsmalbkihvqcf2ujp2trp9cmvf9gjr19vrsdd/family1/1c0cb41c0f414904a731117edb63506b 2023-10-30 14:55:21,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ce3d142d4ba9p6k0aqagbc0qf35qsmalbkihvqcf2ujp2trp9cmvf9gjr19vrsdd/family1/1c0cb41c0f414904a731117edb63506b as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/4683d98e0a0f4c029ec7853fadf3f32d_SeqId_49_ 2023-10-30 14:55:21,198 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ce3d142d4ba9p6k0aqagbc0qf35qsmalbkihvqcf2ujp2trp9cmvf9gjr19vrsdd/family1/1c0cb41c0f414904a731117edb63506b into 90c95f38c99863180384d3d8c5d00bc0/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/4683d98e0a0f4c029ec7853fadf3f32d_SeqId_49_ - updating store file list. 2023-10-30 14:55:21,202 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/4683d98e0a0f4c029ec7853fadf3f32d_SeqId_49_ into 90c95f38c99863180384d3d8c5d00bc0/family1 2023-10-30 14:55:21,202 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ce3d142d4ba9p6k0aqagbc0qf35qsmalbkihvqcf2ujp2trp9cmvf9gjr19vrsdd/family1/1c0cb41c0f414904a731117edb63506b into 90c95f38c99863180384d3d8c5d00bc0/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/4683d98e0a0f4c029ec7853fadf3f32d_SeqId_49_) 2023-10-30 14:55:21,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ce3d142d4ba9p6k0aqagbc0qf35qsmalbkihvqcf2ujp2trp9cmvf9gjr19vrsdd/family1/1c0cb41c0f414904a731117edb63506b 2023-10-30 14:55:21,204 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 14:55:21,205 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:21,206 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120b7f67d1fcb7c4975973a2b2828d07519 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120b7f67d1fcb7c4975973a2b2828d07519 2023-10-30 14:55:21,207 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128e25e26b8e2104881b0a23288c14b0729 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128e25e26b8e2104881b0a23288c14b0729 2023-10-30 14:55:21,208 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130c05445a7fcab425ca4ed2bc3190b5e69 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130c05445a7fcab425ca4ed2bc3190b5e69 2023-10-30 14:55:21,208 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-10-30 14:55:21,208 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-30 14:55:21,209 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 14:55:21,209 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 14:55:21,209 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 14:55:21,209 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 14:55:21,209 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:55:21,211 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 14:55:21,213 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2980 sec 2023-10-30 14:55:21,388 INFO [Listener at localhost/34621] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=260 (was 257) - Thread LEAK? -, OpenFileDescriptor=644 (was 650), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=187 (was 231), ProcessCount=168 (was 168), AvailableMemoryMB=2462 (was 1486) - AvailableMemoryMB LEAK? - 2023-10-30 14:55:21,398 INFO [Listener at localhost/34621] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=260, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=187, ProcessCount=168, AvailableMemoryMB=2462 2023-10-30 14:55:21,413 DEBUG [Listener at localhost/34621] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-10-30 14:55:21,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x00\x16\xA2\xEE\xA2H\x16\x96\x0F"B!\xBE\xC6\xD7\xEE"\x10\x97\xC8uT]\x90P\x83\x00\xEE2\xB2n\xA8\xCFt*\x10\xDF\x87\xF7\x0C[Xa\xC49\xCC\x17Ea\xBF|\x062\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-30 14:55:21,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-10-30 14:55:21,458 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 14:55:21,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-10-30 14:55:21,459 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 14:55:21,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 14:55:21,461 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c 2023-10-30 14:55:21,461 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c 2023-10-30 14:55:21,461 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d 2023-10-30 14:55:21,461 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c empty. 2023-10-30 14:55:21,461 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d empty. 2023-10-30 14:55:21,462 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c empty. 2023-10-30 14:55:21,462 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c 2023-10-30 14:55:21,462 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d 2023-10-30 14:55:21,462 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c 2023-10-30 14:55:21,462 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-10-30 14:55:21,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 14:55:21,573 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/.tmp/family1/674c527b0a4043c59eb59fad4c34666e as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/674c527b0a4043c59eb59fad4c34666e 2023-10-30 14:55:21,581 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 90c95f38c99863180384d3d8c5d00bc0/family1 of 90c95f38c99863180384d3d8c5d00bc0 into 674c527b0a4043c59eb59fad4c34666e(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:55:21,581 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:21,581 INFO [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1698677720727; duration=0sec 2023-10-30 14:55:21,581 DEBUG [RS:0;jenkins-hbase20:36359-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 14:55:21,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/d729ddf3cc3d47e6938ee6ede48358bc, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/a235934632284a27934f08b43c703e97, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/81d0434210ca4e82aaa9bdf74b4279fa_SeqId_47_] to archive 2023-10-30 14:55:21,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:21,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/d729ddf3cc3d47e6938ee6ede48358bc to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/d729ddf3cc3d47e6938ee6ede48358bc 2023-10-30 14:55:21,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/a235934632284a27934f08b43c703e97 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/a235934632284a27934f08b43c703e97 2023-10-30 14:55:21,608 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/81d0434210ca4e82aaa9bdf74b4279fa_SeqId_47_ to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/family1/81d0434210ca4e82aaa9bdf74b4279fa_SeqId_47_ 2023-10-30 14:55:21,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 14:55:21,869 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-10-30 14:55:21,871 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 70f0224570e15e98ba13502cb0256f8c, NAME => 'testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x00\x16\xA2\xEE\xA2H\x16\x96\x0F"B!\xBE\xC6\xD7\xEE"\x10\x97\xC8uT]\x90P\x83\x00\xEE2\xB2n\xA8\xCFt*\x10\xDF\x87\xF7\x0C[Xa\xC49\xCC\x17Ea\xBF|\x062\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:55:21,872 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => ec271b0922387a1f6bc7f4f6943da47d, NAME => 'testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x00\x16\xA2\xEE\xA2H\x16\x96\x0F"B!\xBE\xC6\xD7\xEE"\x10\x97\xC8uT]\x90P\x83\x00\xEE2\xB2n\xA8\xCFt*\x10\xDF\x87\xF7\x0C[Xa\xC49\xCC\x17Ea\xBF|\x062\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:55:21,872 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => a6b42c30fdf80b11a56103e006bbd97c, NAME => 'testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x00\x16\xA2\xEE\xA2H\x16\x96\x0F"B!\xBE\xC6\xD7\xEE"\x10\x97\xC8uT]\x90P\x83\x00\xEE2\xB2n\xA8\xCFt*\x10\xDF\x87\xF7\x0C[Xa\xC49\xCC\x17Ea\xBF|\x062\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/.tmp 2023-10-30 14:55:22,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 14:55:22,284 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:55:22,285 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 70f0224570e15e98ba13502cb0256f8c, disabling compactions & flushes 2023-10-30 14:55:22,285 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:22,285 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:55:22,285 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:22,285 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. after waiting 0 ms 2023-10-30 14:55:22,286 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:22,285 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing ec271b0922387a1f6bc7f4f6943da47d, disabling compactions & flushes 2023-10-30 14:55:22,286 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:22,286 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:22,286 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:22,286 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 70f0224570e15e98ba13502cb0256f8c: 2023-10-30 14:55:22,286 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. after waiting 0 ms 2023-10-30 14:55:22,286 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:22,286 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:22,287 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for ec271b0922387a1f6bc7f4f6943da47d: 2023-10-30 14:55:22,288 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:55:22,289 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing a6b42c30fdf80b11a56103e006bbd97c, disabling compactions & flushes 2023-10-30 14:55:22,289 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:22,289 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:22,289 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. after waiting 0 ms 2023-10-30 14:55:22,289 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:22,289 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:22,289 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for a6b42c30fdf80b11a56103e006bbd97c: 2023-10-30 14:55:22,294 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 14:55:22,296 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698677722296"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677722296"}]},"ts":"1698677722296"} 2023-10-30 14:55:22,296 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698677722296"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677722296"}]},"ts":"1698677722296"} 2023-10-30 14:55:22,296 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698677722296"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698677722296"}]},"ts":"1698677722296"} 2023-10-30 14:55:22,299 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-30 14:55:22,300 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 14:55:22,300 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677722300"}]},"ts":"1698677722300"} 2023-10-30 14:55:22,302 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-10-30 14:55:22,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=70f0224570e15e98ba13502cb0256f8c, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=a6b42c30fdf80b11a56103e006bbd97c, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ec271b0922387a1f6bc7f4f6943da47d, ASSIGN}] 2023-10-30 14:55:22,308 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=a6b42c30fdf80b11a56103e006bbd97c, ASSIGN 2023-10-30 14:55:22,308 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ec271b0922387a1f6bc7f4f6943da47d, ASSIGN 2023-10-30 14:55:22,308 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=70f0224570e15e98ba13502cb0256f8c, ASSIGN 2023-10-30 14:55:22,309 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=a6b42c30fdf80b11a56103e006bbd97c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:55:22,309 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=70f0224570e15e98ba13502cb0256f8c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:55:22,309 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ec271b0922387a1f6bc7f4f6943da47d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36359,1698677568317; forceNewPlan=false, retain=false 2023-10-30 14:55:22,461 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=70f0224570e15e98ba13502cb0256f8c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:22,461 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=ec271b0922387a1f6bc7f4f6943da47d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:22,461 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698677722461"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677722461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677722461"}]},"ts":"1698677722461"} 2023-10-30 14:55:22,461 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=a6b42c30fdf80b11a56103e006bbd97c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:22,461 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698677722461"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677722461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677722461"}]},"ts":"1698677722461"} 2023-10-30 14:55:22,461 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698677722461"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698677722461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698677722461"}]},"ts":"1698677722461"} 2023-10-30 14:55:22,463 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure 70f0224570e15e98ba13502cb0256f8c, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:55:22,463 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure ec271b0922387a1f6bc7f4f6943da47d, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:55:22,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure a6b42c30fdf80b11a56103e006bbd97c, server=jenkins-hbase20.apache.org,36359,1698677568317}] 2023-10-30 14:55:22,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 14:55:22,615 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:22,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:22,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 70f0224570e15e98ba13502cb0256f8c, NAME => 'testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c.', STARTKEY => '', ENDKEY => '1'} 2023-10-30 14:55:22,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 70f0224570e15e98ba13502cb0256f8c 2023-10-30 14:55:22,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:55:22,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 70f0224570e15e98ba13502cb0256f8c 2023-10-30 14:55:22,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 70f0224570e15e98ba13502cb0256f8c 2023-10-30 14:55:22,638 INFO [StoreOpener-70f0224570e15e98ba13502cb0256f8c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 70f0224570e15e98ba13502cb0256f8c 2023-10-30 14:55:22,639 DEBUG [StoreOpener-70f0224570e15e98ba13502cb0256f8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1 2023-10-30 14:55:22,639 DEBUG [StoreOpener-70f0224570e15e98ba13502cb0256f8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1 2023-10-30 14:55:22,640 INFO [StoreOpener-70f0224570e15e98ba13502cb0256f8c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70f0224570e15e98ba13502cb0256f8c columnFamilyName family1 2023-10-30 14:55:22,641 INFO [StoreOpener-70f0224570e15e98ba13502cb0256f8c-1] regionserver.HStore(310): Store=70f0224570e15e98ba13502cb0256f8c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:55:22,641 INFO [StoreOpener-70f0224570e15e98ba13502cb0256f8c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 70f0224570e15e98ba13502cb0256f8c 2023-10-30 14:55:22,642 DEBUG [StoreOpener-70f0224570e15e98ba13502cb0256f8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2 2023-10-30 14:55:22,642 DEBUG [StoreOpener-70f0224570e15e98ba13502cb0256f8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2 2023-10-30 14:55:22,643 INFO [StoreOpener-70f0224570e15e98ba13502cb0256f8c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70f0224570e15e98ba13502cb0256f8c columnFamilyName family2 2023-10-30 14:55:22,644 INFO [StoreOpener-70f0224570e15e98ba13502cb0256f8c-1] regionserver.HStore(310): Store=70f0224570e15e98ba13502cb0256f8c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:55:22,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c 2023-10-30 14:55:22,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c 2023-10-30 14:55:22,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 14:55:22,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 70f0224570e15e98ba13502cb0256f8c 2023-10-30 14:55:22,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:55:22,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 70f0224570e15e98ba13502cb0256f8c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74279301, jitterRate=0.1068478375673294}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 14:55:22,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 70f0224570e15e98ba13502cb0256f8c: 2023-10-30 14:55:22,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c., pid=120, masterSystemTime=1698677722615 2023-10-30 14:55:22,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:22,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:22,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:22,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec271b0922387a1f6bc7f4f6943da47d, NAME => 'testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d.', STARTKEY => '2', ENDKEY => ''} 2023-10-30 14:55:22,650 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=70f0224570e15e98ba13502cb0256f8c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:22,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin ec271b0922387a1f6bc7f4f6943da47d 2023-10-30 14:55:22,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:55:22,650 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698677722650"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677722650"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677722650"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677722650"}]},"ts":"1698677722650"} 2023-10-30 14:55:22,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ec271b0922387a1f6bc7f4f6943da47d 2023-10-30 14:55:22,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ec271b0922387a1f6bc7f4f6943da47d 2023-10-30 14:55:22,652 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=117 2023-10-30 14:55:22,652 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure 70f0224570e15e98ba13502cb0256f8c, server=jenkins-hbase20.apache.org,36359,1698677568317 in 188 msec 2023-10-30 14:55:22,652 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=70f0224570e15e98ba13502cb0256f8c, ASSIGN in 346 msec 2023-10-30 14:55:22,668 INFO [StoreOpener-ec271b0922387a1f6bc7f4f6943da47d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ec271b0922387a1f6bc7f4f6943da47d 2023-10-30 14:55:22,669 DEBUG [StoreOpener-ec271b0922387a1f6bc7f4f6943da47d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1 2023-10-30 14:55:22,669 DEBUG [StoreOpener-ec271b0922387a1f6bc7f4f6943da47d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1 2023-10-30 14:55:22,669 INFO [StoreOpener-ec271b0922387a1f6bc7f4f6943da47d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec271b0922387a1f6bc7f4f6943da47d columnFamilyName family1 2023-10-30 14:55:22,670 INFO [StoreOpener-ec271b0922387a1f6bc7f4f6943da47d-1] regionserver.HStore(310): Store=ec271b0922387a1f6bc7f4f6943da47d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:55:22,670 INFO [StoreOpener-ec271b0922387a1f6bc7f4f6943da47d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ec271b0922387a1f6bc7f4f6943da47d 2023-10-30 14:55:22,671 DEBUG [StoreOpener-ec271b0922387a1f6bc7f4f6943da47d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2 2023-10-30 14:55:22,672 DEBUG [StoreOpener-ec271b0922387a1f6bc7f4f6943da47d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2 2023-10-30 14:55:22,672 INFO [StoreOpener-ec271b0922387a1f6bc7f4f6943da47d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec271b0922387a1f6bc7f4f6943da47d columnFamilyName family2 2023-10-30 14:55:22,672 INFO [StoreOpener-ec271b0922387a1f6bc7f4f6943da47d-1] regionserver.HStore(310): Store=ec271b0922387a1f6bc7f4f6943da47d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:55:22,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d 2023-10-30 14:55:22,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d 2023-10-30 14:55:22,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 14:55:22,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ec271b0922387a1f6bc7f4f6943da47d 2023-10-30 14:55:22,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:55:22,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ec271b0922387a1f6bc7f4f6943da47d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69274633, jitterRate=0.032272472977638245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 14:55:22,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ec271b0922387a1f6bc7f4f6943da47d: 2023-10-30 14:55:22,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d., pid=121, masterSystemTime=1698677722615 2023-10-30 14:55:22,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:22,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:22,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:22,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a6b42c30fdf80b11a56103e006bbd97c, NAME => 'testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c.', STARTKEY => '1', ENDKEY => '2'} 2023-10-30 14:55:22,680 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=ec271b0922387a1f6bc7f4f6943da47d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:22,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin a6b42c30fdf80b11a56103e006bbd97c 2023-10-30 14:55:22,680 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698677722680"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677722680"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677722680"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677722680"}]},"ts":"1698677722680"} 2023-10-30 14:55:22,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 14:55:22,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a6b42c30fdf80b11a56103e006bbd97c 2023-10-30 14:55:22,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a6b42c30fdf80b11a56103e006bbd97c 2023-10-30 14:55:22,682 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=119 2023-10-30 14:55:22,682 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure ec271b0922387a1f6bc7f4f6943da47d, server=jenkins-hbase20.apache.org,36359,1698677568317 in 218 msec 2023-10-30 14:55:22,683 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ec271b0922387a1f6bc7f4f6943da47d, ASSIGN in 376 msec 2023-10-30 14:55:22,699 INFO [StoreOpener-a6b42c30fdf80b11a56103e006bbd97c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a6b42c30fdf80b11a56103e006bbd97c 2023-10-30 14:55:22,700 DEBUG [StoreOpener-a6b42c30fdf80b11a56103e006bbd97c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1 2023-10-30 14:55:22,700 DEBUG [StoreOpener-a6b42c30fdf80b11a56103e006bbd97c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1 2023-10-30 14:55:22,700 INFO [StoreOpener-a6b42c30fdf80b11a56103e006bbd97c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6b42c30fdf80b11a56103e006bbd97c columnFamilyName family1 2023-10-30 14:55:22,701 INFO [StoreOpener-a6b42c30fdf80b11a56103e006bbd97c-1] regionserver.HStore(310): Store=a6b42c30fdf80b11a56103e006bbd97c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:55:22,701 INFO [StoreOpener-a6b42c30fdf80b11a56103e006bbd97c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a6b42c30fdf80b11a56103e006bbd97c 2023-10-30 14:55:22,702 DEBUG [StoreOpener-a6b42c30fdf80b11a56103e006bbd97c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2 2023-10-30 14:55:22,702 DEBUG [StoreOpener-a6b42c30fdf80b11a56103e006bbd97c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2 2023-10-30 14:55:22,703 INFO [StoreOpener-a6b42c30fdf80b11a56103e006bbd97c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6b42c30fdf80b11a56103e006bbd97c columnFamilyName family2 2023-10-30 14:55:22,703 INFO [StoreOpener-a6b42c30fdf80b11a56103e006bbd97c-1] regionserver.HStore(310): Store=a6b42c30fdf80b11a56103e006bbd97c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 14:55:22,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c 2023-10-30 14:55:22,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c 2023-10-30 14:55:22,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 14:55:22,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a6b42c30fdf80b11a56103e006bbd97c 2023-10-30 14:55:22,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 14:55:22,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a6b42c30fdf80b11a56103e006bbd97c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75146488, jitterRate=0.11976993083953857}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 14:55:22,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a6b42c30fdf80b11a56103e006bbd97c: 2023-10-30 14:55:22,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c., pid=122, masterSystemTime=1698677722615 2023-10-30 14:55:22,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:22,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:22,710 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=a6b42c30fdf80b11a56103e006bbd97c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:22,710 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698677722710"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698677722710"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698677722710"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698677722710"}]},"ts":"1698677722710"} 2023-10-30 14:55:22,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=118 2023-10-30 14:55:22,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure a6b42c30fdf80b11a56103e006bbd97c, server=jenkins-hbase20.apache.org,36359,1698677568317 in 247 msec 2023-10-30 14:55:22,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-30 14:55:22,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=a6b42c30fdf80b11a56103e006bbd97c, ASSIGN in 406 msec 2023-10-30 14:55:22,713 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 14:55:22,714 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698677722714"}]},"ts":"1698677722714"} 2023-10-30 14:55:22,715 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-10-30 14:55:22,716 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 14:55:22,717 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2600 sec 2023-10-30 14:55:23,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 14:55:23,569 INFO [Listener at localhost/34621] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-10-30 14:55:23,582 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:55:23,582 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:55:23,583 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:55:23,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:55:23,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-30 14:55:23,588 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-30 14:55:23,588 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:23,588 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-30 14:55:23,588 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-30 14:55:23,588 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:23,588 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:23,589 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:23,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:23,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:23,589 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:23,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:23,590 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:23,590 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:55:23,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:23,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:55:23,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:23,590 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-30 14:55:23,591 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-30 14:55:23,591 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-30 14:55:23,591 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:23,591 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-30 14:55:23,591 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:23,591 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. started... 2023-10-30 14:55:23,591 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 14:55:23,591 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:55:23,591 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:23,592 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. started... 2023-10-30 14:55:23,592 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 70f0224570e15e98ba13502cb0256f8c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 14:55:23,591 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:23,593 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ec271b0922387a1f6bc7f4f6943da47d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 14:55:23,593 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. started... 2023-10-30 14:55:23,593 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a6b42c30fdf80b11a56103e006bbd97c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 14:55:24,028 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030165923040cec49bbbfcad52a249c3c86 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030165923040cec49bbbfcad52a249c3c86 2023-10-30 14:55:24,035 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310301aa23909b01c4931b8690d65dea89267 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310301aa23909b01c4931b8690d65dea89267 2023-10-30 14:55:24,035 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310309839ba060fc34d249a8d7c00528f40e9 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310309839ba060fc34d249a8d7c00528f40e9 2023-10-30 14:55:24,042 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family1/dd0f6818ff2845e4ac920de2db33c2dd 2023-10-30 14:55:24,450 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family1/2bb4e379711b4661a4535c3db712572e 2023-10-30 14:55:24,451 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family1/9c9f963061304fc58ff0bcac6fcb183b 2023-10-30 14:55:24,473 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030cefab13e23e04a51aef46ab5ca11088b to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231030cefab13e23e04a51aef46ab5ca11088b 2023-10-30 14:55:24,881 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family2/1035bd1ecf6f468196f200235dbd5708 2023-10-30 14:55:24,893 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family1/dd0f6818ff2845e4ac920de2db33c2dd as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/dd0f6818ff2845e4ac920de2db33c2dd 2023-10-30 14:55:24,894 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310304a2248c83bc24953912da3cefd9383c6 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202310304a2248c83bc24953912da3cefd9383c6 2023-10-30 14:55:24,895 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310303ec0a82328bb401b8c2fdab58c722a84 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202310303ec0a82328bb401b8c2fdab58c722a84 2023-10-30 14:55:24,908 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family2/90b17766f768411e8226bfb9cbd865b7 2023-10-30 14:55:24,911 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family1/9c9f963061304fc58ff0bcac6fcb183b as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/9c9f963061304fc58ff0bcac6fcb183b 2023-10-30 14:55:24,916 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/dd0f6818ff2845e4ac920de2db33c2dd, entries=4, sequenceid=5, filesize=5.5 K 2023-10-30 14:55:24,917 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family2/1035bd1ecf6f468196f200235dbd5708 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/1035bd1ecf6f468196f200235dbd5708 2023-10-30 14:55:24,920 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/1035bd1ecf6f468196f200235dbd5708, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 14:55:24,921 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 70f0224570e15e98ba13502cb0256f8c in 1329ms, sequenceid=5, compaction requested=false 2023-10-30 14:55:24,921 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-10-30 14:55:24,921 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 70f0224570e15e98ba13502cb0256f8c: 2023-10-30 14:55:24,921 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:24,921 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 14:55:24,930 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/9c9f963061304fc58ff0bcac6fcb183b, entries=4, sequenceid=5, filesize=5.5 K 2023-10-30 14:55:24,930 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family2/90b17766f768411e8226bfb9cbd865b7 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/90b17766f768411e8226bfb9cbd865b7 2023-10-30 14:55:24,933 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/90b17766f768411e8226bfb9cbd865b7, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 14:55:24,934 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a6b42c30fdf80b11a56103e006bbd97c in 1341ms, sequenceid=5, compaction requested=false 2023-10-30 14:55:24,934 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a6b42c30fdf80b11a56103e006bbd97c: 2023-10-30 14:55:24,934 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:24,934 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 14:55:25,309 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family2/ac294c3460e54661b2aa9c3aa316bf28 2023-10-30 14:55:25,319 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family1/2bb4e379711b4661a4535c3db712572e as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/2bb4e379711b4661a4535c3db712572e 2023-10-30 14:55:25,342 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/2bb4e379711b4661a4535c3db712572e, entries=4, sequenceid=5, filesize=5.5 K 2023-10-30 14:55:25,342 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family2/ac294c3460e54661b2aa9c3aa316bf28 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/ac294c3460e54661b2aa9c3aa316bf28 2023-10-30 14:55:25,346 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/ac294c3460e54661b2aa9c3aa316bf28, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 14:55:25,347 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ec271b0922387a1f6bc7f4f6943da47d in 1754ms, sequenceid=5, compaction requested=false 2023-10-30 14:55:25,347 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ec271b0922387a1f6bc7f4f6943da47d: 2023-10-30 14:55:25,347 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:25,347 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 14:55:25,347 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 14:55:25,347 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:25,347 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-30 14:55:25,347 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-30 14:55:25,348 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:25,348 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:25,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:25,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:25,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:25,349 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:25,349 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:55:25,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:25,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:25,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:25,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:25,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:25,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-30 14:55:25,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76d70d46[Count = 0] remaining members to acquire global barrier 2023-10-30 14:55:25,350 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-30 14:55:25,350 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:25,350 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:25,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:25,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:25,351 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-30 14:55:25,351 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:25,351 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:55:25,351 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-30 14:55:25,351 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:55:25,351 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-30 14:55:25,351 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:25,351 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:25,352 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-30 14:55:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:25,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:25,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:25,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:25,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:25,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:55:25,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-30 14:55:25,354 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-30 14:55:25,354 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:55:25,354 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:55:25,354 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-30 14:55:25,354 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:55:25,355 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:25,355 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:25,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:25,355 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:25,355 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:25,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:25,356 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:25,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:25,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:25,357 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:25,357 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:25,357 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:25,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:25,357 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:25,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:25,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-30 14:55:25,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:55:25,357 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:25,357 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:25,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-30 14:55:25,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:25,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:25,358 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:25,358 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-30 14:55:25,358 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:25,358 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:55:25,358 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:25,358 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:25,458 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:55:25,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:55:25,462 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:55:25,463 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:55:25,463 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:55:25,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:55:25,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-30 14:55:25,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-30 14:55:25,473 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-30 14:55:25,473 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:25,473 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-30 14:55:25,473 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-30 14:55:25,473 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:25,473 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:25,474 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:25,474 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:25,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:25,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:25,475 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:25,475 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:55:25,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:25,476 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:25,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:55:25,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:25,476 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-30 14:55:25,476 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-30 14:55:25,477 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-30 14:55:25,477 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-30 14:55:25,477 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:25,477 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-30 14:55:25,477 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:25,477 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. started... 2023-10-30 14:55:25,477 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 14:55:25,477 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:55:25,477 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:25,477 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 70f0224570e15e98ba13502cb0256f8c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 14:55:25,477 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:25,477 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. started... 2023-10-30 14:55:25,478 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. started... 2023-10-30 14:55:25,478 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ec271b0922387a1f6bc7f4f6943da47d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 14:55:25,478 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a6b42c30fdf80b11a56103e006bbd97c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 14:55:25,919 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030913c91e2565a4640b64150a9a007819a to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030913c91e2565a4640b64150a9a007819a 2023-10-30 14:55:25,928 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310309dd920f97bee4de493100f4f8c0428b2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310309dd920f97bee4de493100f4f8c0428b2 2023-10-30 14:55:25,928 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030349c87d6e7f54ada9c1a8c8e3b1fb08a to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030349c87d6e7f54ada9c1a8c8e3b1fb08a 2023-10-30 14:55:26,333 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family1/83a7cfb7e12c4570ab1c05f80f400af7 2023-10-30 14:55:26,343 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family1/29c08d7c5bc84950914dc38abb5a410f 2023-10-30 14:55:26,343 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family1/3cf549906cc84a698d557318bbb9361d 2023-10-30 14:55:26,375 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030f34806dd434246c9ad945197db198c49 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231030f34806dd434246c9ad945197db198c49 2023-10-30 14:55:26,793 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family2/939c696474a446b285e42b5e9c5304fc 2023-10-30 14:55:26,803 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030fc6baeeb35034c92b0d3409feb21c6be to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231030fc6baeeb35034c92b0d3409feb21c6be 2023-10-30 14:55:26,804 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103084a774953c9a4ab1ae007854b2193814 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023103084a774953c9a4ab1ae007854b2193814 2023-10-30 14:55:26,804 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family1/83a7cfb7e12c4570ab1c05f80f400af7 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/83a7cfb7e12c4570ab1c05f80f400af7 2023-10-30 14:55:26,826 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/83a7cfb7e12c4570ab1c05f80f400af7, entries=4, sequenceid=9, filesize=5.5 K 2023-10-30 14:55:26,827 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family2/939c696474a446b285e42b5e9c5304fc as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/939c696474a446b285e42b5e9c5304fc 2023-10-30 14:55:26,830 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/939c696474a446b285e42b5e9c5304fc, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 14:55:26,831 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a6b42c30fdf80b11a56103e006bbd97c in 1353ms, sequenceid=9, compaction requested=false 2023-10-30 14:55:26,831 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a6b42c30fdf80b11a56103e006bbd97c: 2023-10-30 14:55:26,831 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:26,831 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 14:55:27,211 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family2/7063b695c0f34485a17000d6f4efb4ef 2023-10-30 14:55:27,216 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family2/ff3e3874958d46d2a9e6e5d1bddec33d 2023-10-30 14:55:27,224 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family1/29c08d7c5bc84950914dc38abb5a410f as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/29c08d7c5bc84950914dc38abb5a410f 2023-10-30 14:55:27,225 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family1/3cf549906cc84a698d557318bbb9361d as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/3cf549906cc84a698d557318bbb9361d 2023-10-30 14:55:27,254 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/29c08d7c5bc84950914dc38abb5a410f, entries=4, sequenceid=9, filesize=5.5 K 2023-10-30 14:55:27,254 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/3cf549906cc84a698d557318bbb9361d, entries=4, sequenceid=9, filesize=5.5 K 2023-10-30 14:55:27,255 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family2/ff3e3874958d46d2a9e6e5d1bddec33d as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/ff3e3874958d46d2a9e6e5d1bddec33d 2023-10-30 14:55:27,256 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family2/7063b695c0f34485a17000d6f4efb4ef as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/7063b695c0f34485a17000d6f4efb4ef 2023-10-30 14:55:27,259 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/ff3e3874958d46d2a9e6e5d1bddec33d, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 14:55:27,259 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/7063b695c0f34485a17000d6f4efb4ef, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 14:55:27,259 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ec271b0922387a1f6bc7f4f6943da47d in 1781ms, sequenceid=9, compaction requested=false 2023-10-30 14:55:27,259 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 70f0224570e15e98ba13502cb0256f8c in 1782ms, sequenceid=9, compaction requested=false 2023-10-30 14:55:27,259 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ec271b0922387a1f6bc7f4f6943da47d: 2023-10-30 14:55:27,259 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 70f0224570e15e98ba13502cb0256f8c: 2023-10-30 14:55:27,259 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:27,259 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:27,259 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 14:55:27,259 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 14:55:27,259 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 14:55:27,259 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:27,260 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-30 14:55:27,260 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-30 14:55:27,260 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:27,260 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:27,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:27,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:27,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:27,261 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:27,261 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:55:27,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:27,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:27,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:27,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:27,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:27,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-30 14:55:27,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e23bb45[Count = 0] remaining members to acquire global barrier 2023-10-30 14:55:27,262 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-30 14:55:27,262 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:27,262 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:27,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:27,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:27,262 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-30 14:55:27,262 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-30 14:55:27,262 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:55:27,262 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:27,262 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:55:27,263 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:27,263 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-30 14:55:27,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:27,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:27,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:27,263 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:27,263 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-30 14:55:27,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:27,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:27,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:27,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:27,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:27,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:27,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:27,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:55:27,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-30 14:55:27,265 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-30 14:55:27,265 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:55:27,265 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:55:27,265 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-30 14:55:27,265 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:55:27,266 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:27,266 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:27,266 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:27,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:27,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:27,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:27,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:27,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:27,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:27,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:27,268 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:27,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:27,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:27,270 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:27,272 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:27,272 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:27,272 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:27,272 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:27,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-30 14:55:27,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:55:27,272 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:27,272 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:27,272 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:27,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:27,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:27,272 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-30 14:55:27,272 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:55:27,272 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:27,272 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:27,273 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:27,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:27,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:27,372 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:55:27,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:55:27,374 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:55:27,375 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:55:27,375 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:55:27,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:55:27,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-30 14:55:27,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-30 14:55:27,382 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-30 14:55:27,382 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:27,383 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-30 14:55:27,383 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-30 14:55:27,383 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:27,383 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:27,384 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:27,384 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:27,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:27,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:27,385 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:27,385 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:55:27,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:27,385 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:27,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:55:27,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:27,386 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-30 14:55:27,386 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-30 14:55:27,386 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-30 14:55:27,386 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-30 14:55:27,386 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:27,386 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-30 14:55:27,386 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:27,386 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. started... 2023-10-30 14:55:27,386 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 14:55:27,386 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:27,387 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. started... 2023-10-30 14:55:27,386 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:27,387 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a6b42c30fdf80b11a56103e006bbd97c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 14:55:27,387 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. started... 2023-10-30 14:55:27,386 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 70f0224570e15e98ba13502cb0256f8c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 14:55:27,387 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ec271b0922387a1f6bc7f4f6943da47d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 14:55:27,386 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:55:27,437 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310300ad8fa1aad7b44ffa03066f1a883800e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310300ad8fa1aad7b44ffa03066f1a883800e 2023-10-30 14:55:27,437 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030882a77e1289140b796923258a88c292e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030882a77e1289140b796923258a88c292e 2023-10-30 14:55:27,449 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030381b1843a3d64d8b9fe74f18128cd329 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030381b1843a3d64d8b9fe74f18128cd329 2023-10-30 14:55:27,451 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family1/60bdd390565c4529b6cef2d10bb5c911 2023-10-30 14:55:27,850 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family1/765f2986cfc74739a6d964af21e9feed 2023-10-30 14:55:27,863 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family1/0041c87b2e4f43d3ae5bd267741875e8 2023-10-30 14:55:27,880 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030e4f0d99545ef40a5838f6f3fe1cb44da to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231030e4f0d99545ef40a5838f6f3fe1cb44da 2023-10-30 14:55:27,901 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310309d495273e45e44e2aa46c6dff8632bd8 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202310309d495273e45e44e2aa46c6dff8632bd8 2023-10-30 14:55:28,155 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 14:55:28,290 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family2/6d1b939a04214f45875c5d9f55a6fbc0 2023-10-30 14:55:28,294 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family1/60bdd390565c4529b6cef2d10bb5c911 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/60bdd390565c4529b6cef2d10bb5c911 2023-10-30 14:55:28,301 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103067a62c0af4784dbdbe4f905d3221c06a to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023103067a62c0af4784dbdbe4f905d3221c06a 2023-10-30 14:55:28,307 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family2/6d4acfaa75404d10924d110891d754b8 2023-10-30 14:55:28,310 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family1/765f2986cfc74739a6d964af21e9feed as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/765f2986cfc74739a6d964af21e9feed 2023-10-30 14:55:28,317 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/60bdd390565c4529b6cef2d10bb5c911, entries=4, sequenceid=13, filesize=5.5 K 2023-10-30 14:55:28,318 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family2/6d1b939a04214f45875c5d9f55a6fbc0 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/6d1b939a04214f45875c5d9f55a6fbc0 2023-10-30 14:55:28,322 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/6d1b939a04214f45875c5d9f55a6fbc0, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 14:55:28,322 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a6b42c30fdf80b11a56103e006bbd97c in 935ms, sequenceid=13, compaction requested=true 2023-10-30 14:55:28,322 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a6b42c30fdf80b11a56103e006bbd97c: 2023-10-30 14:55:28,323 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:28,323 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 14:55:28,330 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/765f2986cfc74739a6d964af21e9feed, entries=4, sequenceid=13, filesize=5.5 K 2023-10-30 14:55:28,331 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family2/6d4acfaa75404d10924d110891d754b8 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/6d4acfaa75404d10924d110891d754b8 2023-10-30 14:55:28,335 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/6d4acfaa75404d10924d110891d754b8, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 14:55:28,335 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ec271b0922387a1f6bc7f4f6943da47d in 948ms, sequenceid=13, compaction requested=true 2023-10-30 14:55:28,335 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ec271b0922387a1f6bc7f4f6943da47d: 2023-10-30 14:55:28,335 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:28,336 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 14:55:28,705 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family2/91788250c8fb413a93d3c401d5856cd5 2023-10-30 14:55:28,710 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family1/0041c87b2e4f43d3ae5bd267741875e8 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/0041c87b2e4f43d3ae5bd267741875e8 2023-10-30 14:55:28,729 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/0041c87b2e4f43d3ae5bd267741875e8, entries=4, sequenceid=13, filesize=5.5 K 2023-10-30 14:55:28,730 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family2/91788250c8fb413a93d3c401d5856cd5 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/91788250c8fb413a93d3c401d5856cd5 2023-10-30 14:55:28,733 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/91788250c8fb413a93d3c401d5856cd5, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 14:55:28,734 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 70f0224570e15e98ba13502cb0256f8c in 1348ms, sequenceid=13, compaction requested=true 2023-10-30 14:55:28,734 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 70f0224570e15e98ba13502cb0256f8c: 2023-10-30 14:55:28,734 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:28,734 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 14:55:28,734 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 14:55:28,734 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:28,735 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-30 14:55:28,735 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-30 14:55:28,736 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:28,736 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:28,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:28,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:28,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:28,736 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:28,736 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:55:28,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:28,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:28,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:28,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:28,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:28,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-30 14:55:28,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78396d5e[Count = 0] remaining members to acquire global barrier 2023-10-30 14:55:28,738 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-30 14:55:28,738 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:28,738 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:28,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:28,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:28,739 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-30 14:55:28,739 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-30 14:55:28,739 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:55:28,739 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:28,739 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:55:28,739 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-30 14:55:28,739 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:28,739 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:28,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:28,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:28,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:28,739 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-30 14:55:28,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:28,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:28,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:28,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:28,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:28,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:28,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:28,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:55:28,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-30 14:55:28,741 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-30 14:55:28,741 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:55:28,741 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:55:28,741 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-30 14:55:28,742 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:55:28,742 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:28,742 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:28,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:28,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:28,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:28,743 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:28,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:28,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:28,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:28,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:28,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:28,743 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:28,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:28,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:28,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:28,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:28,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:28,744 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:28,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:28,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:28,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:28,747 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:28,747 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:28,747 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:28,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-30 14:55:28,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:55:28,747 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:28,747 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:28,747 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:28,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:28,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:28,747 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:28,747 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-30 14:55:28,747 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:28,748 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:55:28,748 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:28,748 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:28,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:28,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:28,848 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:55:28,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:55:28,850 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:55:28,850 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:55:28,850 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 14:55:28,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:55:28,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-30 14:55:28,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-30 14:55:28,854 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-30 14:55:28,854 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:28,854 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-30 14:55:28,854 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-30 14:55:28,854 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:28,854 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:28,855 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:28,855 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:28,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:28,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:28,855 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:28,855 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:55:28,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:28,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:28,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:55:28,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:28,856 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-30 14:55:28,856 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-30 14:55:28,856 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-30 14:55:28,856 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-30 14:55:28,856 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:28,856 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-30 14:55:28,856 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:28,856 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 14:55:28,856 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:55:28,856 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:28,856 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:28,856 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. started... 2023-10-30 14:55:28,857 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. started... 2023-10-30 14:55:28,856 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. started... 2023-10-30 14:55:28,857 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a6b42c30fdf80b11a56103e006bbd97c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 14:55:28,857 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ec271b0922387a1f6bc7f4f6943da47d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 14:55:28,857 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 70f0224570e15e98ba13502cb0256f8c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 14:55:28,905 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030add98a4461ba4f2b8c508c0cf340b837 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030add98a4461ba4f2b8c508c0cf340b837 2023-10-30 14:55:29,304 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103001b299071f284b71b5bc0896192d99e4 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103001b299071f284b71b5bc0896192d99e4 2023-10-30 14:55:29,304 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103065dc3001a21744f0aafc527d90f3396a to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023103065dc3001a21744f0aafc527d90f3396a 2023-10-30 14:55:29,319 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family1/80c71c69beae4d209e592fa17ba3c314 2023-10-30 14:55:29,321 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family1/ce58e310475e4e44969274abb51cd452 2023-10-30 14:55:29,721 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family1/6f859f89f0e84c148ae07280389e0557 2023-10-30 14:55:29,749 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103001270aa43f904d3f8d920ced3bbd4f2c to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023103001270aa43f904d3f8d920ced3bbd4f2c 2023-10-30 14:55:29,751 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310304331004f80934563bf7574e6a9a038ff to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202310304331004f80934563bf7574e6a9a038ff 2023-10-30 14:55:29,759 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family2/3a48813e848e403b986eebb6e1010098 2023-10-30 14:55:29,762 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310305c2cfb9e567a40e7881ffcb0e65dddb4 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202310305c2cfb9e567a40e7881ffcb0e65dddb4 2023-10-30 14:55:29,763 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family1/80c71c69beae4d209e592fa17ba3c314 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/80c71c69beae4d209e592fa17ba3c314 2023-10-30 14:55:29,769 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family2/3e99468f88e64764874f4ef3e6ec846d 2023-10-30 14:55:29,773 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family1/ce58e310475e4e44969274abb51cd452 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/ce58e310475e4e44969274abb51cd452 2023-10-30 14:55:29,795 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/80c71c69beae4d209e592fa17ba3c314, entries=4, sequenceid=17, filesize=5.5 K 2023-10-30 14:55:29,796 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family2/3a48813e848e403b986eebb6e1010098 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/3a48813e848e403b986eebb6e1010098 2023-10-30 14:55:29,800 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/3a48813e848e403b986eebb6e1010098, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 14:55:29,801 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a6b42c30fdf80b11a56103e006bbd97c in 944ms, sequenceid=17, compaction requested=true 2023-10-30 14:55:29,801 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a6b42c30fdf80b11a56103e006bbd97c: 2023-10-30 14:55:29,801 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:29,801 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 14:55:29,804 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/ce58e310475e4e44969274abb51cd452, entries=4, sequenceid=17, filesize=5.5 K 2023-10-30 14:55:29,805 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family2/3e99468f88e64764874f4ef3e6ec846d as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/3e99468f88e64764874f4ef3e6ec846d 2023-10-30 14:55:29,808 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/3e99468f88e64764874f4ef3e6ec846d, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 14:55:29,809 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ec271b0922387a1f6bc7f4f6943da47d in 952ms, sequenceid=17, compaction requested=true 2023-10-30 14:55:29,809 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ec271b0922387a1f6bc7f4f6943da47d: 2023-10-30 14:55:29,809 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:29,809 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 14:55:30,169 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family2/4868fb38fe0246e1b5ba17fb3aa212b8 2023-10-30 14:55:30,173 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family1/6f859f89f0e84c148ae07280389e0557 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/6f859f89f0e84c148ae07280389e0557 2023-10-30 14:55:30,202 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/6f859f89f0e84c148ae07280389e0557, entries=4, sequenceid=17, filesize=5.5 K 2023-10-30 14:55:30,203 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family2/4868fb38fe0246e1b5ba17fb3aa212b8 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/4868fb38fe0246e1b5ba17fb3aa212b8 2023-10-30 14:55:30,207 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/4868fb38fe0246e1b5ba17fb3aa212b8, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 14:55:30,208 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 70f0224570e15e98ba13502cb0256f8c in 1351ms, sequenceid=17, compaction requested=true 2023-10-30 14:55:30,208 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 70f0224570e15e98ba13502cb0256f8c: 2023-10-30 14:55:30,208 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:30,208 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 14:55:30,208 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 14:55:30,208 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:30,208 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-30 14:55:30,208 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-30 14:55:30,209 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:30,209 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:30,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:30,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:30,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:30,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:30,210 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:30,210 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:55:30,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:30,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:30,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:30,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:30,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-30 14:55:30,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bf3188f[Count = 0] remaining members to acquire global barrier 2023-10-30 14:55:30,211 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-30 14:55:30,211 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:30,211 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:30,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:30,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:30,211 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-30 14:55:30,211 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-30 14:55:30,211 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:55:30,211 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:30,212 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:55:30,212 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-30 14:55:30,212 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:30,212 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:30,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:30,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:30,212 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-30 14:55:30,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:30,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:30,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:30,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:30,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:30,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:30,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:30,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:30,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:55:30,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-30 14:55:30,214 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-30 14:55:30,214 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:55:30,214 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:55:30,214 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-30 14:55:30,214 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:55:30,215 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:30,215 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:30,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:30,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:30,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:30,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:30,215 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:30,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:30,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:30,216 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:30,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:30,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:30,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:30,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:30,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:30,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:30,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:30,217 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:30,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:30,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:30,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:30,218 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:30,218 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:30,218 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:30,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:30,218 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:30,218 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:30,218 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:30,218 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:30,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-30 14:55:30,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:30,218 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:30,218 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:30,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:30,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:30,220 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:30,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-30 14:55:30,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:55:30,221 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-30 14:55:30,221 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:55:30,321 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:55:30,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:55:30,332 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:55:30,340 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:55:30,350 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:55:30,351 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:55:30,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 14:55:30,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-30 14:55:30,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-30 14:55:30,480 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-30 14:55:30,480 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:30,480 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-30 14:55:30,480 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-30 14:55:30,480 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:30,480 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:30,481 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:30,481 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:30,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:30,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:30,481 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:30,481 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 14:55:30,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:30,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:30,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 14:55:30,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:30,482 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-30 14:55:30,483 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-30 14:55:30,483 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-30 14:55:30,483 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-30 14:55:30,483 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 14:55:30,483 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-30 14:55:30,486 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:30,486 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. started... 2023-10-30 14:55:30,486 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:30,486 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 14:55:30,486 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 14:55:30,486 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 70f0224570e15e98ba13502cb0256f8c 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 14:55:30,486 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:30,487 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. started... 2023-10-30 14:55:30,486 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. started... 2023-10-30 14:55:30,487 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a6b42c30fdf80b11a56103e006bbd97c 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 14:55:30,487 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ec271b0922387a1f6bc7f4f6943da47d 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 14:55:30,937 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family1/39bc522cd12c476eaf1a5f4e746d9441 2023-10-30 14:55:30,971 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family1/815e5d1939a145cb9e369385424932a0 2023-10-30 14:55:30,974 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 39bc522cd12c476eaf1a5f4e746d9441 2023-10-30 14:55:30,989 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family2/1090f6123ad340aca62d1bc4b6dac9e0 2023-10-30 14:55:30,992 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1090f6123ad340aca62d1bc4b6dac9e0 2023-10-30 14:55:30,992 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family1/39bc522cd12c476eaf1a5f4e746d9441 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/39bc522cd12c476eaf1a5f4e746d9441 2023-10-30 14:55:31,003 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 815e5d1939a145cb9e369385424932a0 2023-10-30 14:55:31,016 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 39bc522cd12c476eaf1a5f4e746d9441 2023-10-30 14:55:31,016 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/39bc522cd12c476eaf1a5f4e746d9441, entries=3, sequenceid=23, filesize=5.2 K 2023-10-30 14:55:31,017 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family2/1090f6123ad340aca62d1bc4b6dac9e0 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/1090f6123ad340aca62d1bc4b6dac9e0 2023-10-30 14:55:31,020 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1090f6123ad340aca62d1bc4b6dac9e0 2023-10-30 14:55:31,020 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/1090f6123ad340aca62d1bc4b6dac9e0, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 14:55:31,021 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 70f0224570e15e98ba13502cb0256f8c in 535ms, sequenceid=23, compaction requested=true 2023-10-30 14:55:31,021 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 70f0224570e15e98ba13502cb0256f8c: 2023-10-30 14:55:31,021 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:31,021 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 14:55:31,368 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family1/f224615a80f148f4ba0594b40c84f4e5 2023-10-30 14:55:31,388 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f224615a80f148f4ba0594b40c84f4e5 2023-10-30 14:55:31,822 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family2/a5bcf1fa0a294f06a14da0211e6c1244 2023-10-30 14:55:31,825 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a5bcf1fa0a294f06a14da0211e6c1244 2023-10-30 14:55:31,826 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family1/815e5d1939a145cb9e369385424932a0 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/815e5d1939a145cb9e369385424932a0 2023-10-30 14:55:31,847 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 815e5d1939a145cb9e369385424932a0 2023-10-30 14:55:31,848 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/815e5d1939a145cb9e369385424932a0, entries=3, sequenceid=23, filesize=5.2 K 2023-10-30 14:55:31,849 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family2/a5bcf1fa0a294f06a14da0211e6c1244 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/a5bcf1fa0a294f06a14da0211e6c1244 2023-10-30 14:55:31,853 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a5bcf1fa0a294f06a14da0211e6c1244 2023-10-30 14:55:31,853 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/a5bcf1fa0a294f06a14da0211e6c1244, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 14:55:31,854 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a6b42c30fdf80b11a56103e006bbd97c in 1367ms, sequenceid=23, compaction requested=true 2023-10-30 14:55:31,854 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a6b42c30fdf80b11a56103e006bbd97c: 2023-10-30 14:55:31,854 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:31,854 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 14:55:32,199 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family2/fda00dc13b704b929c94997836a0c600 2023-10-30 14:55:32,203 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fda00dc13b704b929c94997836a0c600 2023-10-30 14:55:32,204 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family1/f224615a80f148f4ba0594b40c84f4e5 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/f224615a80f148f4ba0594b40c84f4e5 2023-10-30 14:55:32,224 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f224615a80f148f4ba0594b40c84f4e5 2023-10-30 14:55:32,224 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/f224615a80f148f4ba0594b40c84f4e5, entries=3, sequenceid=23, filesize=5.2 K 2023-10-30 14:55:32,225 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family2/fda00dc13b704b929c94997836a0c600 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/fda00dc13b704b929c94997836a0c600 2023-10-30 14:55:32,229 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fda00dc13b704b929c94997836a0c600 2023-10-30 14:55:32,229 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/fda00dc13b704b929c94997836a0c600, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 14:55:32,230 INFO [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ec271b0922387a1f6bc7f4f6943da47d in 1743ms, sequenceid=23, compaction requested=true 2023-10-30 14:55:32,230 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ec271b0922387a1f6bc7f4f6943da47d: 2023-10-30 14:55:32,230 DEBUG [rs(jenkins-hbase20.apache.org,36359,1698677568317)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:32,230 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 14:55:32,230 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 14:55:32,230 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:32,230 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-30 14:55:32,230 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-30 14:55:32,232 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:32,232 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:32,232 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:32,232 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 14:55:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:32,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:32,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:32,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:32,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36359,1698677568317' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-30 14:55:32,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a2103f8[Count = 0] remaining members to acquire global barrier 2023-10-30 14:55:32,233 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-30 14:55:32,233 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:32,234 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:32,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:32,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:32,234 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-30 14:55:32,234 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-30 14:55:32,234 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,36359,1698677568317' in zk 2023-10-30 14:55:32,234 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:32,234 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 14:55:32,234 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-30 14:55:32,234 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:32,234 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:32,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:32,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:32,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:32,234 DEBUG [member: 'jenkins-hbase20.apache.org,36359,1698677568317' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-30 14:55:32,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:32,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:32,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:32,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:32,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:32,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:32,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:32,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,36359,1698677568317': 2023-10-30 14:55:32,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36359,1698677568317' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-30 14:55:32,236 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-30 14:55:32,236 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 14:55:32,236 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 14:55:32,236 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-30 14:55:32,236 INFO [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 14:55:32,237 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:32,237 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:32,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:32,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 14:55:32,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 14:55:32,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:32,237 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:32,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:32,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 14:55:32,237 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:32,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:32,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 14:55:32,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:32,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:32,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:32,239 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:32,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 14:55:32,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 14:55:32,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:32,241 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:32,241 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 14:55:32,241 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 14:55:32,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-30 14:55:32,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 14:55:32,241 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:32,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 14:55:32,241 DEBUG [(jenkins-hbase20.apache.org,43911,1698677567334)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 14:55:32,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 14:55:32,241 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-30 14:55:32,241 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 14:55:32,241 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 14:55:32,241 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-30 14:55:32,241 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:32,241 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:32,241 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 14:55:32,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 14:55:32,241 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 14:55:32,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 14:55:32,341 DEBUG [Listener at localhost/34621] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 14:55:32,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43911] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 14:55:32,343 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:55:32,344 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): 70f0224570e15e98ba13502cb0256f8c/family1 is initiating major compaction (all files) 2023-10-30 14:55:32,344 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:55:32,344 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:55:32,344 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of 70f0224570e15e98ba13502cb0256f8c/family1 in testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:32,344 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/dd0f6818ff2845e4ac920de2db33c2dd, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/29c08d7c5bc84950914dc38abb5a410f, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/0041c87b2e4f43d3ae5bd267741875e8, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/6f859f89f0e84c148ae07280389e0557, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/39bc522cd12c476eaf1a5f4e746d9441] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp, totalSize=27.1 K 2023-10-30 14:55:32,345 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting dd0f6818ff2845e4ac920de2db33c2dd, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677723582 2023-10-30 14:55:32,346 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 29c08d7c5bc84950914dc38abb5a410f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677725462 2023-10-30 14:55:32,347 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 0041c87b2e4f43d3ae5bd267741875e8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677727374 2023-10-30 14:55:32,348 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 6f859f89f0e84c148ae07280389e0557, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677728850 2023-10-30 14:55:32,349 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 39bc522cd12c476eaf1a5f4e746d9441, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 14:55:32,367 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): 70f0224570e15e98ba13502cb0256f8c#family1#compaction#198 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:55:32,808 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023103037ad78b52d52441fa4658c84605b6737_del 2023-10-30 14:55:32,808 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103037ad78b52d52441fa4658c84605b6737_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103037ad78b52d52441fa4658c84605b6737_del 2023-10-30 14:55:33,663 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c42d43b82d9b421185e1178aa2695f38 2023-10-30 14:55:33,664 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family1/c42d43b82d9b421185e1178aa2695f38 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/c42d43b82d9b421185e1178aa2695f38 2023-10-30 14:55:33,683 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c42d43b82d9b421185e1178aa2695f38 2023-10-30 14:55:33,684 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 70f0224570e15e98ba13502cb0256f8c/family1 of 70f0224570e15e98ba13502cb0256f8c into c42d43b82d9b421185e1178aa2695f38(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:55:33,684 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for 70f0224570e15e98ba13502cb0256f8c: 2023-10-30 14:55:33,684 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:55:33,685 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): 70f0224570e15e98ba13502cb0256f8c/family2 is initiating major compaction (all files) 2023-10-30 14:55:33,685 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:55:33,685 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:55:33,695 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of 70f0224570e15e98ba13502cb0256f8c/family2 in testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:33,695 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/1035bd1ecf6f468196f200235dbd5708, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/7063b695c0f34485a17000d6f4efb4ef, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/91788250c8fb413a93d3c401d5856cd5, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/4868fb38fe0246e1b5ba17fb3aa212b8, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/1090f6123ad340aca62d1bc4b6dac9e0] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp, totalSize=25.4 K 2023-10-30 14:55:33,696 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 1035bd1ecf6f468196f200235dbd5708, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677723582 2023-10-30 14:55:33,696 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 7063b695c0f34485a17000d6f4efb4ef, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677725462 2023-10-30 14:55:33,696 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 91788250c8fb413a93d3c401d5856cd5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677727374 2023-10-30 14:55:33,697 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 4868fb38fe0246e1b5ba17fb3aa212b8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677728850 2023-10-30 14:55:33,697 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 1090f6123ad340aca62d1bc4b6dac9e0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 14:55:33,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/dd0f6818ff2845e4ac920de2db33c2dd, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/29c08d7c5bc84950914dc38abb5a410f, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/0041c87b2e4f43d3ae5bd267741875e8, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/6f859f89f0e84c148ae07280389e0557, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/39bc522cd12c476eaf1a5f4e746d9441] to archive 2023-10-30 14:55:33,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:33,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/dd0f6818ff2845e4ac920de2db33c2dd to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/dd0f6818ff2845e4ac920de2db33c2dd 2023-10-30 14:55:33,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/29c08d7c5bc84950914dc38abb5a410f to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/29c08d7c5bc84950914dc38abb5a410f 2023-10-30 14:55:33,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/0041c87b2e4f43d3ae5bd267741875e8 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/0041c87b2e4f43d3ae5bd267741875e8 2023-10-30 14:55:33,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/6f859f89f0e84c148ae07280389e0557 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/6f859f89f0e84c148ae07280389e0557 2023-10-30 14:55:33,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/39bc522cd12c476eaf1a5f4e746d9441 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/39bc522cd12c476eaf1a5f4e746d9441 2023-10-30 14:55:33,725 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): 70f0224570e15e98ba13502cb0256f8c#family2#compaction#199 average throughput is 0.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:55:34,149 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023103066befe40286a4abe9cd65115e8cfe0e7_del 2023-10-30 14:55:34,149 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103066befe40286a4abe9cd65115e8cfe0e7_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023103066befe40286a4abe9cd65115e8cfe0e7_del 2023-10-30 14:55:34,571 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73c39c3b4bc74d95a21fe7301952ece0 2023-10-30 14:55:34,573 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/.tmp/family2/73c39c3b4bc74d95a21fe7301952ece0 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/73c39c3b4bc74d95a21fe7301952ece0 2023-10-30 14:55:34,577 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73c39c3b4bc74d95a21fe7301952ece0 2023-10-30 14:55:34,578 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 70f0224570e15e98ba13502cb0256f8c/family2 of 70f0224570e15e98ba13502cb0256f8c into 73c39c3b4bc74d95a21fe7301952ece0(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:55:34,578 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for 70f0224570e15e98ba13502cb0256f8c: 2023-10-30 14:55:34,578 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:55:34,578 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): ec271b0922387a1f6bc7f4f6943da47d/family1 is initiating major compaction (all files) 2023-10-30 14:55:34,578 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:55:34,578 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:55:34,579 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of ec271b0922387a1f6bc7f4f6943da47d/family1 in testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:34,579 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/2bb4e379711b4661a4535c3db712572e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/3cf549906cc84a698d557318bbb9361d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/765f2986cfc74739a6d964af21e9feed, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/ce58e310475e4e44969274abb51cd452, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/f224615a80f148f4ba0594b40c84f4e5] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp, totalSize=27.1 K 2023-10-30 14:55:34,579 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 2bb4e379711b4661a4535c3db712572e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677723583 2023-10-30 14:55:34,580 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 3cf549906cc84a698d557318bbb9361d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677725463 2023-10-30 14:55:34,580 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 765f2986cfc74739a6d964af21e9feed, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677727375 2023-10-30 14:55:34,580 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting ce58e310475e4e44969274abb51cd452, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677728850 2023-10-30 14:55:34,581 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting f224615a80f148f4ba0594b40c84f4e5, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 14:55:34,589 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): ec271b0922387a1f6bc7f4f6943da47d#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:55:34,610 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/1035bd1ecf6f468196f200235dbd5708, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/7063b695c0f34485a17000d6f4efb4ef, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/91788250c8fb413a93d3c401d5856cd5, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/4868fb38fe0246e1b5ba17fb3aa212b8, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/1090f6123ad340aca62d1bc4b6dac9e0] to archive 2023-10-30 14:55:34,614 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:34,615 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 14:55:34,615 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x274bfe34 to 127.0.0.1:49804 2023-10-30 14:55:34,615 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:55:34,615 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/1035bd1ecf6f468196f200235dbd5708 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/1035bd1ecf6f468196f200235dbd5708 2023-10-30 14:55:34,616 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/7063b695c0f34485a17000d6f4efb4ef to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/7063b695c0f34485a17000d6f4efb4ef 2023-10-30 14:55:34,617 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/91788250c8fb413a93d3c401d5856cd5 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/91788250c8fb413a93d3c401d5856cd5 2023-10-30 14:55:34,618 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/4868fb38fe0246e1b5ba17fb3aa212b8 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/4868fb38fe0246e1b5ba17fb3aa212b8 2023-10-30 14:55:34,619 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/1090f6123ad340aca62d1bc4b6dac9e0 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family2/1090f6123ad340aca62d1bc4b6dac9e0 2023-10-30 14:55:35,059 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023103028065b027fad4280ba7f6bdd3384ff9b_del 2023-10-30 14:55:35,060 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103028065b027fad4280ba7f6bdd3384ff9b_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023103028065b027fad4280ba7f6bdd3384ff9b_del 2023-10-30 14:55:35,526 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 973fce2ca7f443a39d69d71107cfcac8 2023-10-30 14:55:35,527 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family1/973fce2ca7f443a39d69d71107cfcac8 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/973fce2ca7f443a39d69d71107cfcac8 2023-10-30 14:55:35,550 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 973fce2ca7f443a39d69d71107cfcac8 2023-10-30 14:55:35,551 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ec271b0922387a1f6bc7f4f6943da47d/family1 of ec271b0922387a1f6bc7f4f6943da47d into 973fce2ca7f443a39d69d71107cfcac8(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:55:35,552 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for ec271b0922387a1f6bc7f4f6943da47d: 2023-10-30 14:55:35,552 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:55:35,552 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): ec271b0922387a1f6bc7f4f6943da47d/family2 is initiating major compaction (all files) 2023-10-30 14:55:35,552 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:55:35,552 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:55:35,553 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of ec271b0922387a1f6bc7f4f6943da47d/family2 in testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:35,553 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/ac294c3460e54661b2aa9c3aa316bf28, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/ff3e3874958d46d2a9e6e5d1bddec33d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/6d4acfaa75404d10924d110891d754b8, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/3e99468f88e64764874f4ef3e6ec846d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/fda00dc13b704b929c94997836a0c600] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp, totalSize=25.4 K 2023-10-30 14:55:35,554 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting ac294c3460e54661b2aa9c3aa316bf28, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677723583 2023-10-30 14:55:35,554 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting ff3e3874958d46d2a9e6e5d1bddec33d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677725463 2023-10-30 14:55:35,555 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 6d4acfaa75404d10924d110891d754b8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677727375 2023-10-30 14:55:35,555 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 3e99468f88e64764874f4ef3e6ec846d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677728850 2023-10-30 14:55:35,555 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting fda00dc13b704b929c94997836a0c600, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 14:55:35,564 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): ec271b0922387a1f6bc7f4f6943da47d#family2#compaction#201 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:55:35,603 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/2bb4e379711b4661a4535c3db712572e, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/3cf549906cc84a698d557318bbb9361d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/765f2986cfc74739a6d964af21e9feed, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/ce58e310475e4e44969274abb51cd452, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/f224615a80f148f4ba0594b40c84f4e5] to archive 2023-10-30 14:55:35,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:35,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/2bb4e379711b4661a4535c3db712572e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/2bb4e379711b4661a4535c3db712572e 2023-10-30 14:55:35,606 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/3cf549906cc84a698d557318bbb9361d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/3cf549906cc84a698d557318bbb9361d 2023-10-30 14:55:35,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/765f2986cfc74739a6d964af21e9feed to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/765f2986cfc74739a6d964af21e9feed 2023-10-30 14:55:35,608 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/ce58e310475e4e44969274abb51cd452 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/ce58e310475e4e44969274abb51cd452 2023-10-30 14:55:35,609 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/f224615a80f148f4ba0594b40c84f4e5 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/f224615a80f148f4ba0594b40c84f4e5 2023-10-30 14:55:35,978 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231030f099a6720cdc45f4be810e4a4536ad3a_del 2023-10-30 14:55:35,979 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030f099a6720cdc45f4be810e4a4536ad3a_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231030f099a6720cdc45f4be810e4a4536ad3a_del 2023-10-30 14:55:35,998 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0f8d25f1b5964a1ab103e4083a291ac3 2023-10-30 14:55:35,998 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/.tmp/family2/0f8d25f1b5964a1ab103e4083a291ac3 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/0f8d25f1b5964a1ab103e4083a291ac3 2023-10-30 14:55:36,002 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0f8d25f1b5964a1ab103e4083a291ac3 2023-10-30 14:55:36,003 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ec271b0922387a1f6bc7f4f6943da47d/family2 of ec271b0922387a1f6bc7f4f6943da47d into 0f8d25f1b5964a1ab103e4083a291ac3(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 14:55:36,003 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for ec271b0922387a1f6bc7f4f6943da47d: 2023-10-30 14:55:36,003 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:55:36,004 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): a6b42c30fdf80b11a56103e006bbd97c/family1 is initiating major compaction (all files) 2023-10-30 14:55:36,004 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:55:36,004 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:55:36,004 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of a6b42c30fdf80b11a56103e006bbd97c/family1 in testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:36,004 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/9c9f963061304fc58ff0bcac6fcb183b, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/83a7cfb7e12c4570ab1c05f80f400af7, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/60bdd390565c4529b6cef2d10bb5c911, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/80c71c69beae4d209e592fa17ba3c314, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/815e5d1939a145cb9e369385424932a0] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp, totalSize=27.1 K 2023-10-30 14:55:36,005 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 9c9f963061304fc58ff0bcac6fcb183b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677723582 2023-10-30 14:55:36,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/ac294c3460e54661b2aa9c3aa316bf28, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/ff3e3874958d46d2a9e6e5d1bddec33d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/6d4acfaa75404d10924d110891d754b8, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/3e99468f88e64764874f4ef3e6ec846d, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/fda00dc13b704b929c94997836a0c600] to archive 2023-10-30 14:55:36,005 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 83a7cfb7e12c4570ab1c05f80f400af7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677725463 2023-10-30 14:55:36,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:36,006 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 60bdd390565c4529b6cef2d10bb5c911, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677727375 2023-10-30 14:55:36,006 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 80c71c69beae4d209e592fa17ba3c314, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677728850 2023-10-30 14:55:36,007 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 815e5d1939a145cb9e369385424932a0, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 14:55:36,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/ac294c3460e54661b2aa9c3aa316bf28 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/ac294c3460e54661b2aa9c3aa316bf28 2023-10-30 14:55:36,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/ff3e3874958d46d2a9e6e5d1bddec33d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/ff3e3874958d46d2a9e6e5d1bddec33d 2023-10-30 14:55:36,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/6d4acfaa75404d10924d110891d754b8 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/6d4acfaa75404d10924d110891d754b8 2023-10-30 14:55:36,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/3e99468f88e64764874f4ef3e6ec846d to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/3e99468f88e64764874f4ef3e6ec846d 2023-10-30 14:55:36,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/fda00dc13b704b929c94997836a0c600 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family2/fda00dc13b704b929c94997836a0c600 2023-10-30 14:55:36,018 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): a6b42c30fdf80b11a56103e006bbd97c#family1#compaction#202 average throughput is 1.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:55:36,461 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231030a58b5af23e6841499c5fc2a1b5f087f3_del 2023-10-30 14:55:36,461 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030a58b5af23e6841499c5fc2a1b5f087f3_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030a58b5af23e6841499c5fc2a1b5f087f3_del 2023-10-30 14:55:37,317 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b34e70e9224b45568e2e7617ba83c552 2023-10-30 14:55:37,317 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family1/b34e70e9224b45568e2e7617ba83c552 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/b34e70e9224b45568e2e7617ba83c552 2023-10-30 14:55:37,336 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b34e70e9224b45568e2e7617ba83c552 2023-10-30 14:55:37,337 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a6b42c30fdf80b11a56103e006bbd97c/family1 of a6b42c30fdf80b11a56103e006bbd97c into b34e70e9224b45568e2e7617ba83c552(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:55:37,337 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for a6b42c30fdf80b11a56103e006bbd97c: 2023-10-30 14:55:37,337 DEBUG [Listener at localhost/34621] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 14:55:37,337 DEBUG [Listener at localhost/34621] regionserver.HStore(1912): a6b42c30fdf80b11a56103e006bbd97c/family2 is initiating major compaction (all files) 2023-10-30 14:55:37,337 INFO [Listener at localhost/34621] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 14:55:37,337 INFO [Listener at localhost/34621] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 14:55:37,337 INFO [Listener at localhost/34621] regionserver.HRegion(2259): Starting compaction of a6b42c30fdf80b11a56103e006bbd97c/family2 in testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:37,337 INFO [Listener at localhost/34621] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/90b17766f768411e8226bfb9cbd865b7, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/939c696474a446b285e42b5e9c5304fc, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/6d1b939a04214f45875c5d9f55a6fbc0, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/3a48813e848e403b986eebb6e1010098, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/a5bcf1fa0a294f06a14da0211e6c1244] into tmpdir=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp, totalSize=25.4 K 2023-10-30 14:55:37,338 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 90b17766f768411e8226bfb9cbd865b7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698677723582 2023-10-30 14:55:37,338 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 939c696474a446b285e42b5e9c5304fc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698677725463 2023-10-30 14:55:37,338 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 6d1b939a04214f45875c5d9f55a6fbc0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698677727375 2023-10-30 14:55:37,339 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting 3a48813e848e403b986eebb6e1010098, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698677728850 2023-10-30 14:55:37,339 DEBUG [Listener at localhost/34621] compactions.Compactor(207): Compacting a5bcf1fa0a294f06a14da0211e6c1244, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 14:55:37,345 INFO [Listener at localhost/34621] throttle.PressureAwareThroughputController(145): a6b42c30fdf80b11a56103e006bbd97c#family2#compaction#203 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 14:55:37,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/9c9f963061304fc58ff0bcac6fcb183b, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/83a7cfb7e12c4570ab1c05f80f400af7, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/60bdd390565c4529b6cef2d10bb5c911, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/80c71c69beae4d209e592fa17ba3c314, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/815e5d1939a145cb9e369385424932a0] to archive 2023-10-30 14:55:37,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:37,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/9c9f963061304fc58ff0bcac6fcb183b to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/9c9f963061304fc58ff0bcac6fcb183b 2023-10-30 14:55:37,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/83a7cfb7e12c4570ab1c05f80f400af7 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/83a7cfb7e12c4570ab1c05f80f400af7 2023-10-30 14:55:37,409 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/60bdd390565c4529b6cef2d10bb5c911 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/60bdd390565c4529b6cef2d10bb5c911 2023-10-30 14:55:37,410 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/80c71c69beae4d209e592fa17ba3c314 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/80c71c69beae4d209e592fa17ba3c314 2023-10-30 14:55:37,411 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/815e5d1939a145cb9e369385424932a0 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/815e5d1939a145cb9e369385424932a0 2023-10-30 14:55:37,752 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231030ec16f289902e4dfcac699f668029dd8a_del 2023-10-30 14:55:37,752 INFO [Listener at localhost/34621] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030ec16f289902e4dfcac699f668029dd8a_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231030ec16f289902e4dfcac699f668029dd8a_del 2023-10-30 14:55:38,564 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 850bde8f5abd45da8ac66055cf64a2cf 2023-10-30 14:55:38,565 DEBUG [Listener at localhost/34621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/.tmp/family2/850bde8f5abd45da8ac66055cf64a2cf as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/850bde8f5abd45da8ac66055cf64a2cf 2023-10-30 14:55:38,569 INFO [Listener at localhost/34621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 850bde8f5abd45da8ac66055cf64a2cf 2023-10-30 14:55:38,569 INFO [Listener at localhost/34621] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a6b42c30fdf80b11a56103e006bbd97c/family2 of a6b42c30fdf80b11a56103e006bbd97c into 850bde8f5abd45da8ac66055cf64a2cf(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 14:55:38,569 DEBUG [Listener at localhost/34621] regionserver.HRegion(2289): Compaction status journal for a6b42c30fdf80b11a56103e006bbd97c: 2023-10-30 14:55:38,572 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:55:38,575 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:55:38,579 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:55:38,580 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:55:38,584 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43911] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x00\x16\xA2\xEE\xA2H\x16\x96\x0F"B!\xBE\xC6\xD7\xEE"\x10\x97\xC8uT]\x90P\x83\x00\xEE2\xB2n\xA8\xCFt*\x10\xDF\x87\xF7\x0C[Xa\xC49\xCC\x17Ea\xBF|\x062\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-10-30 14:55:38,604 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-30 14:55:38,605 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-30 14:55:38,606 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:55:38,606 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698678338606 2023-10-30 14:55:38,607 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 14:55:38,609 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/90b17766f768411e8226bfb9cbd865b7, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/939c696474a446b285e42b5e9c5304fc, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/6d1b939a04214f45875c5d9f55a6fbc0, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/3a48813e848e403b986eebb6e1010098, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/a5bcf1fa0a294f06a14da0211e6c1244] to archive 2023-10-30 14:55:38,610 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:38,611 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/90b17766f768411e8226bfb9cbd865b7 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/90b17766f768411e8226bfb9cbd865b7 2023-10-30 14:55:38,612 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/939c696474a446b285e42b5e9c5304fc to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/939c696474a446b285e42b5e9c5304fc 2023-10-30 14:55:38,613 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/6d1b939a04214f45875c5d9f55a6fbc0 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/6d1b939a04214f45875c5d9f55a6fbc0 2023-10-30 14:55:38,614 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/3a48813e848e403b986eebb6e1010098 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/3a48813e848e403b986eebb6e1010098 2023-10-30 14:55:38,615 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/a5bcf1fa0a294f06a14da0211e6c1244 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family2/a5bcf1fa0a294f06a14da0211e6c1244 2023-10-30 14:55:38,936 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-10-30 14:55:38,957 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023103037ad78b52d52441fa4658c84605b6737_del 2023-10-30 14:55:38,982 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231030a58b5af23e6841499c5fc2a1b5f087f3_del 2023-10-30 14:55:39,004 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023103028065b027fad4280ba7f6bdd3384ff9b_del 2023-10-30 14:55:39,004 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 14:55:39,005 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] zookeeper.ReadOnlyZKClient(139): Connect 0x5df29275 to 127.0.0.1:49804 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 14:55:39,009 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e8aca0e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 14:55:39,010 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 14:55:39,611 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030870302bd27404b2081ae73cedaf732d4 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030870302bd27404b2081ae73cedaf732d4 2023-10-30 14:55:39,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 14:55:39,627 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 14:55:39,631 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 14:55:39,651 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 14:55:39,654 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 14:55:39,703 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231030/family1/806737c333f14b49ae68c47948971464 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-10-30 14:55:39,705 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231030/family1/806737c333f14b49ae68c47948971464}] 2023-10-30 14:55:39,713 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231030/family1/806737c333f14b49ae68c47948971464 for inclusion in ec271b0922387a1f6bc7f4f6943da47d/family1 2023-10-30 14:55:39,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-10-30 14:55:39,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-30 14:55:39,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for ec271b0922387a1f6bc7f4f6943da47d: 2023-10-30 14:55:39,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231030/family1/806737c333f14b49ae68c47948971464 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionFromAdmin__equlmfs90bctnh2s80832dtt5nme3nig318280u2ofbeq1bv7qgsiaodppjft2t/family1/806737c333f14b49ae68c47948971464 2023-10-30 14:55:39,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionFromAdmin__equlmfs90bctnh2s80832dtt5nme3nig318280u2ofbeq1bv7qgsiaodppjft2t/family1/806737c333f14b49ae68c47948971464 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/26d8d6d1417c49ca8eeeb4970675bb67_SeqId_28_ 2023-10-30 14:55:39,740 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionFromAdmin__equlmfs90bctnh2s80832dtt5nme3nig318280u2ofbeq1bv7qgsiaodppjft2t/family1/806737c333f14b49ae68c47948971464 into ec271b0922387a1f6bc7f4f6943da47d/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/26d8d6d1417c49ca8eeeb4970675bb67_SeqId_28_ - updating store file list. 2023-10-30 14:55:39,780 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/26d8d6d1417c49ca8eeeb4970675bb67_SeqId_28_ into ec271b0922387a1f6bc7f4f6943da47d/family1 2023-10-30 14:55:39,780 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionFromAdmin__equlmfs90bctnh2s80832dtt5nme3nig318280u2ofbeq1bv7qgsiaodppjft2t/family1/806737c333f14b49ae68c47948971464 into ec271b0922387a1f6bc7f4f6943da47d/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/family1/26d8d6d1417c49ca8eeeb4970675bb67_SeqId_28_) 2023-10-30 14:55:39,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionFromAdmin__equlmfs90bctnh2s80832dtt5nme3nig318280u2ofbeq1bv7qgsiaodppjft2t/family1/806737c333f14b49ae68c47948971464 2023-10-30 14:55:39,783 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 14:55:39,784 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:39,785 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310300ad8fa1aad7b44ffa03066f1a883800e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310300ad8fa1aad7b44ffa03066f1a883800e 2023-10-30 14:55:39,786 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310309839ba060fc34d249a8d7c00528f40e9 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310309839ba060fc34d249a8d7c00528f40e9 2023-10-30 14:55:39,789 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310309dd920f97bee4de493100f4f8c0428b2 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310309dd920f97bee4de493100f4f8c0428b2 2023-10-30 14:55:39,790 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030add98a4461ba4f2b8c508c0cf340b837 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030add98a4461ba4f2b8c508c0cf340b837 2023-10-30 14:55:39,790 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-30 14:55:39,791 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231030' 2023-10-30 14:55:39,791 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 14:55:39,791 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 14:55:40,375 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103049cbb35384944ef2b500dd970ef87adc to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103049cbb35384944ef2b500dd970ef87adc 2023-10-30 14:55:40,376 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 14:55:40,425 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231030/family1/52e5fbb05c53489fa34455a73e1f500f first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-10-30 14:55:40,426 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231030/family1/52e5fbb05c53489fa34455a73e1f500f}] 2023-10-30 14:55:40,437 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231030/family1/52e5fbb05c53489fa34455a73e1f500f for inclusion in 70f0224570e15e98ba13502cb0256f8c/family1 2023-10-30 14:55:40,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-10-30 14:55:40,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(777): Region bounds: first= last=1 2023-10-30 14:55:40,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for 70f0224570e15e98ba13502cb0256f8c: 2023-10-30 14:55:40,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231030/family1/52e5fbb05c53489fa34455a73e1f500f to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionFromAdmin__2gnn0imdjqeh4bdtvoj6gr634admo781j75vj400hghud9pte68faldga1al5la0/family1/52e5fbb05c53489fa34455a73e1f500f 2023-10-30 14:55:40,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionFromAdmin__2gnn0imdjqeh4bdtvoj6gr634admo781j75vj400hghud9pte68faldga1al5la0/family1/52e5fbb05c53489fa34455a73e1f500f as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/c8c199d34af6424caf25366b47a0834b_SeqId_28_ 2023-10-30 14:55:40,469 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionFromAdmin__2gnn0imdjqeh4bdtvoj6gr634admo781j75vj400hghud9pte68faldga1al5la0/family1/52e5fbb05c53489fa34455a73e1f500f into 70f0224570e15e98ba13502cb0256f8c/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/c8c199d34af6424caf25366b47a0834b_SeqId_28_ - updating store file list. 2023-10-30 14:55:40,496 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/c8c199d34af6424caf25366b47a0834b_SeqId_28_ into 70f0224570e15e98ba13502cb0256f8c/family1 2023-10-30 14:55:40,497 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionFromAdmin__2gnn0imdjqeh4bdtvoj6gr634admo781j75vj400hghud9pte68faldga1al5la0/family1/52e5fbb05c53489fa34455a73e1f500f into 70f0224570e15e98ba13502cb0256f8c/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/family1/c8c199d34af6424caf25366b47a0834b_SeqId_28_) 2023-10-30 14:55:40,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionFromAdmin__2gnn0imdjqeh4bdtvoj6gr634admo781j75vj400hghud9pte68faldga1al5la0/family1/52e5fbb05c53489fa34455a73e1f500f 2023-10-30 14:55:40,502 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 14:55:40,502 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:40,504 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103001b299071f284b71b5bc0896192d99e4 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103001b299071f284b71b5bc0896192d99e4 2023-10-30 14:55:40,505 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030165923040cec49bbbfcad52a249c3c86 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030165923040cec49bbbfcad52a249c3c86 2023-10-30 14:55:40,506 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030349c87d6e7f54ada9c1a8c8e3b1fb08a to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030349c87d6e7f54ada9c1a8c8e3b1fb08a 2023-10-30 14:55:40,507 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030381b1843a3d64d8b9fe74f18128cd329 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030381b1843a3d64d8b9fe74f18128cd329 2023-10-30 14:55:40,507 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-30 14:55:40,507 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231030' 2023-10-30 14:55:40,508 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 14:55:40,508 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 14:55:41,476 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103092a14b3ccbaf41b8b296795eced1a10e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023103092a14b3ccbaf41b8b296795eced1a10e 2023-10-30 14:55:41,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 14:55:41,519 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231030/family1/3b08107fc4dc44459ab3eb64ea9a0ceb first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-10-30 14:55:41,520 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c., hostname=jenkins-hbase20.apache.org,36359,1698677568317, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231030/family1/3b08107fc4dc44459ab3eb64ea9a0ceb}] 2023-10-30 14:55:41,522 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(763): Validating hfile at hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231030/family1/3b08107fc4dc44459ab3eb64ea9a0ceb for inclusion in a6b42c30fdf80b11a56103e006bbd97c/family1 2023-10-30 14:55:41,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-10-30 14:55:41,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-30 14:55:41,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegion(2446): Flush status journal for a6b42c30fdf80b11a56103e006bbd97c: 2023-10-30 14:55:41,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231030/family1/3b08107fc4dc44459ab3eb64ea9a0ceb to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionFromAdmin__9o42pliuvncaslrp17qvrbqmfesgtqtlrjim7o2662mp17b9c03ckl0q8jnf7v5o/family1/3b08107fc4dc44459ab3eb64ea9a0ceb 2023-10-30 14:55:41,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionFromAdmin__9o42pliuvncaslrp17qvrbqmfesgtqtlrjim7o2662mp17b9c03ckl0q8jnf7v5o/family1/3b08107fc4dc44459ab3eb64ea9a0ceb as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/a38e325b69ba43e39126e49d49b3bf46_SeqId_28_ 2023-10-30 14:55:41,553 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(849): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionFromAdmin__9o42pliuvncaslrp17qvrbqmfesgtqtlrjim7o2662mp17b9c03ckl0q8jnf7v5o/family1/3b08107fc4dc44459ab3eb64ea9a0ceb into a6b42c30fdf80b11a56103e006bbd97c/family1 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/a38e325b69ba43e39126e49d49b3bf46_SeqId_28_ - updating store file list. 2023-10-30 14:55:41,579 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(882): Loaded HFile hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/a38e325b69ba43e39126e49d49b3bf46_SeqId_28_ into a6b42c30fdf80b11a56103e006bbd97c/family1 2023-10-30 14:55:41,579 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.HStore(855): Successfully loaded hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionFromAdmin__9o42pliuvncaslrp17qvrbqmfesgtqtlrjim7o2662mp17b9c03ckl0q8jnf7v5o/family1/3b08107fc4dc44459ab3eb64ea9a0ceb into a6b42c30fdf80b11a56103e006bbd97c/family1 (new location: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/family1/a38e325b69ba43e39126e49d49b3bf46_SeqId_28_) 2023-10-30 14:55:41,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36359] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/staging/jenkins__testMajorCompactionFromAdmin__9o42pliuvncaslrp17qvrbqmfesgtqtlrjim7o2662mp17b9c03ckl0q8jnf7v5o/family1/3b08107fc4dc44459ab3eb64ea9a0ceb 2023-10-30 14:55:41,581 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 14:55:41,582 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:41,583 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310301aa23909b01c4931b8690d65dea89267 to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310301aa23909b01c4931b8690d65dea89267 2023-10-30 14:55:41,584 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023103065dc3001a21744f0aafc527d90f3396a to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023103065dc3001a21744f0aafc527d90f3396a 2023-10-30 14:55:41,585 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030882a77e1289140b796923258a88c292e to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030882a77e1289140b796923258a88c292e 2023-10-30 14:55:41,585 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030913c91e2565a4640b64150a9a007819a to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030913c91e2565a4640b64150a9a007819a 2023-10-30 14:55:41,586 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-30 14:55:41,586 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231030' 2023-10-30 14:55:41,586 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 14:55:41,586 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 14:55:41,586 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 14:55:41,586 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103037ad78b52d52441fa4658c84605b6737_del] 2023-10-30 14:55:41,587 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:41,588 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103037ad78b52d52441fa4658c84605b6737_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103037ad78b52d52441fa4658c84605b6737_del 2023-10-30 14:55:41,588 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-30 14:55:41,588 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030a58b5af23e6841499c5fc2a1b5f087f3_del] 2023-10-30 14:55:41,588 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:41,589 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030a58b5af23e6841499c5fc2a1b5f087f3_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030a58b5af23e6841499c5fc2a1b5f087f3_del 2023-10-30 14:55:41,589 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-30 14:55:41,589 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023103028065b027fad4280ba7f6bdd3384ff9b_del] 2023-10-30 14:55:41,590 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 14:55:41,590 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023103028065b027fad4280ba7f6bdd3384ff9b_del to hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023103028065b027fad4280ba7f6bdd3384ff9b_del 2023-10-30 14:55:41,590 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-30 14:55:41,590 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698677572093] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 14:55:41,591 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-30 14:55:41,593 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.9880 sec 2023-10-30 14:55:41,614 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:55:41,616 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:55:41,619 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 14:55:41,620 DEBUG [Listener at localhost/34621] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 14:55:41,624 INFO [Listener at localhost/34621] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 14:55:41,658 INFO [Listener at localhost/34621] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=248 (was 260), OpenFileDescriptor=635 (was 644), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=186 (was 187), ProcessCount=168 (was 168), AvailableMemoryMB=2127 (was 2462) 2023-10-30 14:55:41,659 DEBUG [Listener at localhost/34621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00418667 to 127.0.0.1:49804 2023-10-30 14:55:41,659 DEBUG [Listener at localhost/34621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:55:41,659 INFO [Listener at localhost/34621] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-30 14:55:41,660 INFO [Listener at localhost/34621] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 14:55:41,660 DEBUG [Listener at localhost/34621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22e51859 to 127.0.0.1:49804 2023-10-30 14:55:41,660 DEBUG [Listener at localhost/34621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:55:41,660 DEBUG [Listener at localhost/34621] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-30 14:55:41,660 DEBUG [Listener at localhost/34621] util.JVMClusterUtil(257): Found active master hash=451728749, stopped=false 2023-10-30 14:55:41,660 INFO [Listener at localhost/34621] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase20.apache.org,43911,1698677567334 2023-10-30 14:55:41,661 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-30 14:55:41,661 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-30 14:55:41,661 INFO [Listener at localhost/34621] procedure2.ProcedureExecutor(628): Stopping 2023-10-30 14:55:41,661 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 14:55:41,661 DEBUG [Listener at localhost/34621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6eddd9e8 to 127.0.0.1:49804 2023-10-30 14:55:41,661 DEBUG [Listener at localhost/34621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:55:41,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-30 14:55:41,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-30 14:55:41,661 INFO [Listener at localhost/34621] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,36359,1698677568317' ***** 2023-10-30 14:55:41,661 INFO [Listener at localhost/34621] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-30 14:55:41,662 INFO [RS:0;jenkins-hbase20:36359] regionserver.HeapMemoryManager(220): Stopping 2023-10-30 14:55:41,662 INFO [RS:0;jenkins-hbase20:36359] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-30 14:55:41,662 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-30 14:55:41,662 INFO [RS:0;jenkins-hbase20:36359] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-30 14:55:41,662 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for ca132995761ed98f70b5bb299b22d780 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for 90c95f38c99863180384d3d8c5d00bc0 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for 953b179baa5064d7c5b98a46f266b330 2023-10-30 14:55:41,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ca132995761ed98f70b5bb299b22d780, disabling compactions & flushes 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for 47028b3909b824fbdc0fcfdc181fdd27 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for 152dd2029edf29e5f98fc7ec046f7767 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for 704a96c7dc9afead8f729d6f37747ec5 2023-10-30 14:55:41,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for 70f0224570e15e98ba13502cb0256f8c 2023-10-30 14:55:41,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for 177e982e175e289e7a05a97bd09698ab 2023-10-30 14:55:41,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. after waiting 0 ms 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for 067dfd97cc9f142313f90d932310385c 2023-10-30 14:55:41,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for 5a58af8ecbd95665bdfc67556085c433 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for ab337776724960eefa44070b970f617f 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for ae3648a2636fe2f7065dcbeb2d18bd58 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for ec271b0922387a1f6bc7f4f6943da47d 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for a6b42c30fdf80b11a56103e006bbd97c 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for 8461785ef16c68760c326406dffef392 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for bb974e53dc6d462888c86a0e83d2293c 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for 575c0b5fb7911565c72999b4af89996c 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for 48f76e58a4a35e9459816951bbe6c769 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for bb4420255160505884d9c82dfe0aed2b 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for ae1fa8048a3a8e4b39683c8300846593 2023-10-30 14:55:41,663 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:41,663 DEBUG [RS:0;jenkins-hbase20:36359] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ce9878e to 127.0.0.1:49804 2023-10-30 14:55:41,663 DEBUG [RS:0;jenkins-hbase20:36359] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:55:41,664 INFO [RS:0;jenkins-hbase20:36359] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-30 14:55:41,664 INFO [RS:0;jenkins-hbase20:36359] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-30 14:55:41,664 INFO [RS:0;jenkins-hbase20:36359] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-30 14:55:41,664 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-30 14:55:41,664 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-10-30 14:55:41,664 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-30 14:55:41,664 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-30 14:55:41,664 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-30 14:55:41,664 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-30 14:55:41,664 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-30 14:55:41,664 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-10-30 14:55:41,665 DEBUG [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1504): Waiting on 067dfd97cc9f142313f90d932310385c, 152dd2029edf29e5f98fc7ec046f7767, 1588230740, 177e982e175e289e7a05a97bd09698ab, 47028b3909b824fbdc0fcfdc181fdd27, 48f76e58a4a35e9459816951bbe6c769, 575c0b5fb7911565c72999b4af89996c, 5a58af8ecbd95665bdfc67556085c433, 704a96c7dc9afead8f729d6f37747ec5, 70f0224570e15e98ba13502cb0256f8c, 8461785ef16c68760c326406dffef392, 90c95f38c99863180384d3d8c5d00bc0, 953b179baa5064d7c5b98a46f266b330, a6b42c30fdf80b11a56103e006bbd97c, ab337776724960eefa44070b970f617f, ae1fa8048a3a8e4b39683c8300846593, ae3648a2636fe2f7065dcbeb2d18bd58, bb4420255160505884d9c82dfe0aed2b, bb974e53dc6d462888c86a0e83d2293c, ca132995761ed98f70b5bb299b22d780, ec271b0922387a1f6bc7f4f6943da47d 2023-10-30 14:55:41,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ca132995761ed98f70b5bb299b22d780/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-10-30 14:55:41,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:55:41,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ca132995761ed98f70b5bb299b22d780: 2023-10-30 14:55:41,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698677628040.ca132995761ed98f70b5bb299b22d780. 2023-10-30 14:55:41,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 90c95f38c99863180384d3d8c5d00bc0, disabling compactions & flushes 2023-10-30 14:55:41,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:41,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:41,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. after waiting 0 ms 2023-10-30 14:55:41,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:41,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithMonthlyPolicy/90c95f38c99863180384d3d8c5d00bc0/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-10-30 14:55:41,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:41,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 90c95f38c99863180384d3d8c5d00bc0: 2023-10-30 14:55:41,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1698677708657.90c95f38c99863180384d3d8c5d00bc0. 2023-10-30 14:55:41,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 953b179baa5064d7c5b98a46f266b330, disabling compactions & flushes 2023-10-30 14:55:41,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:55:41,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:55:41,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. after waiting 0 ms 2023-10-30 14:55:41,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:55:41,673 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-30 14:55:41,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/953b179baa5064d7c5b98a46f266b330/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 14:55:41,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:55:41,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 953b179baa5064d7c5b98a46f266b330: 2023-10-30 14:55:41,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1698677692379.953b179baa5064d7c5b98a46f266b330. 2023-10-30 14:55:41,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 47028b3909b824fbdc0fcfdc181fdd27, disabling compactions & flushes 2023-10-30 14:55:41,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. 2023-10-30 14:55:41,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. 2023-10-30 14:55:41,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. after waiting 0 ms 2023-10-30 14:55:41,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. 2023-10-30 14:55:41,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/47028b3909b824fbdc0fcfdc181fdd27/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-10-30 14:55:41,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. 2023-10-30 14:55:41,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 47028b3909b824fbdc0fcfdc181fdd27: 2023-10-30 14:55:41,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1698677609283.47028b3909b824fbdc0fcfdc181fdd27. 2023-10-30 14:55:41,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 152dd2029edf29e5f98fc7ec046f7767, disabling compactions & flushes 2023-10-30 14:55:41,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:55:41,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:55:41,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. after waiting 0 ms 2023-10-30 14:55:41,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:55:41,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMinorCompactionWithWeeklyPolicy/152dd2029edf29e5f98fc7ec046f7767/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-30 14:55:41,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:55:41,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 152dd2029edf29e5f98fc7ec046f7767: 2023-10-30 14:55:41,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1698677597073.152dd2029edf29e5f98fc7ec046f7767. 2023-10-30 14:55:41,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 704a96c7dc9afead8f729d6f37747ec5, disabling compactions & flushes 2023-10-30 14:55:41,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. 2023-10-30 14:55:41,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. 2023-10-30 14:55:41,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. after waiting 0 ms 2023-10-30 14:55:41,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. 2023-10-30 14:55:41,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/704a96c7dc9afead8f729d6f37747ec5/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-10-30 14:55:41,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. 2023-10-30 14:55:41,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 704a96c7dc9afead8f729d6f37747ec5: 2023-10-30 14:55:41,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1698677609283.704a96c7dc9afead8f729d6f37747ec5. 2023-10-30 14:55:41,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 70f0224570e15e98ba13502cb0256f8c, disabling compactions & flushes 2023-10-30 14:55:41,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:41,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:41,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. after waiting 0 ms 2023-10-30 14:55:41,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:41,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/70f0224570e15e98ba13502cb0256f8c/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 14:55:41,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:41,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 70f0224570e15e98ba13502cb0256f8c: 2023-10-30 14:55:41,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1698677721432.70f0224570e15e98ba13502cb0256f8c. 2023-10-30 14:55:41,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 177e982e175e289e7a05a97bd09698ab, disabling compactions & flushes 2023-10-30 14:55:41,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:55:41,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:55:41,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. after waiting 0 ms 2023-10-30 14:55:41,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:55:41,702 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-10-30 14:55:41,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/177e982e175e289e7a05a97bd09698ab/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-30 14:55:41,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:55:41,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 177e982e175e289e7a05a97bd09698ab: 2023-10-30 14:55:41,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1698677667058.177e982e175e289e7a05a97bd09698ab. 2023-10-30 14:55:41,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 067dfd97cc9f142313f90d932310385c, disabling compactions & flushes 2023-10-30 14:55:41,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:55:41,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:55:41,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. after waiting 0 ms 2023-10-30 14:55:41,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:55:41,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/067dfd97cc9f142313f90d932310385c/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-10-30 14:55:41,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:55:41,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 067dfd97cc9f142313f90d932310385c: 2023-10-30 14:55:41,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698677572264.067dfd97cc9f142313f90d932310385c. 2023-10-30 14:55:41,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5a58af8ecbd95665bdfc67556085c433, disabling compactions & flushes 2023-10-30 14:55:41,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433. 2023-10-30 14:55:41,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433. 2023-10-30 14:55:41,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433. after waiting 0 ms 2023-10-30 14:55:41,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433. 2023-10-30 14:55:41,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 5a58af8ecbd95665bdfc67556085c433 1/1 column families, dataSize=109 B heapSize=592 B 2023-10-30 14:55:41,865 DEBUG [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1504): Waiting on 1588230740, 48f76e58a4a35e9459816951bbe6c769, 575c0b5fb7911565c72999b4af89996c, 5a58af8ecbd95665bdfc67556085c433, 8461785ef16c68760c326406dffef392, a6b42c30fdf80b11a56103e006bbd97c, ab337776724960eefa44070b970f617f, ae1fa8048a3a8e4b39683c8300846593, ae3648a2636fe2f7065dcbeb2d18bd58, bb4420255160505884d9c82dfe0aed2b, bb974e53dc6d462888c86a0e83d2293c, ec271b0922387a1f6bc7f4f6943da47d 2023-10-30 14:55:41,924 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-30 14:55:41,924 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-30 14:55:42,065 DEBUG [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1504): Waiting on 1588230740, 48f76e58a4a35e9459816951bbe6c769, 575c0b5fb7911565c72999b4af89996c, 5a58af8ecbd95665bdfc67556085c433, 8461785ef16c68760c326406dffef392, a6b42c30fdf80b11a56103e006bbd97c, ab337776724960eefa44070b970f617f, ae1fa8048a3a8e4b39683c8300846593, ae3648a2636fe2f7065dcbeb2d18bd58, bb4420255160505884d9c82dfe0aed2b, bb974e53dc6d462888c86a0e83d2293c, ec271b0922387a1f6bc7f4f6943da47d 2023-10-30 14:55:42,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/.tmp/info/f43ac092921646eea1d0723152896a6b 2023-10-30 14:55:42,084 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f43ac092921646eea1d0723152896a6b 2023-10-30 14:55:42,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/namespace/5a58af8ecbd95665bdfc67556085c433/.tmp/info/e889f464f0ae4fb8b9c07b54774acc93 2023-10-30 14:55:42,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/namespace/5a58af8ecbd95665bdfc67556085c433/.tmp/info/e889f464f0ae4fb8b9c07b54774acc93 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/namespace/5a58af8ecbd95665bdfc67556085c433/info/e889f464f0ae4fb8b9c07b54774acc93 2023-10-30 14:55:42,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/namespace/5a58af8ecbd95665bdfc67556085c433/info/e889f464f0ae4fb8b9c07b54774acc93, entries=3, sequenceid=7, filesize=4.8 K 2023-10-30 14:55:42,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 5a58af8ecbd95665bdfc67556085c433 in 427ms, sequenceid=7, compaction requested=false 2023-10-30 14:55:42,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/namespace/5a58af8ecbd95665bdfc67556085c433/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-10-30 14:55:42,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433. 2023-10-30 14:55:42,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5a58af8ecbd95665bdfc67556085c433: 2023-10-30 14:55:42,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1698677570948.5a58af8ecbd95665bdfc67556085c433. 2023-10-30 14:55:42,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ab337776724960eefa44070b970f617f, disabling compactions & flushes 2023-10-30 14:55:42,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:55:42,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:55:42,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. after waiting 0 ms 2023-10-30 14:55:42,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:55:42,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/ab337776724960eefa44070b970f617f/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 14:55:42,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:55:42,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ab337776724960eefa44070b970f617f: 2023-10-30 14:55:42,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1698677692379.ab337776724960eefa44070b970f617f. 2023-10-30 14:55:42,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ae3648a2636fe2f7065dcbeb2d18bd58, disabling compactions & flushes 2023-10-30 14:55:42,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:55:42,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:55:42,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. after waiting 0 ms 2023-10-30 14:55:42,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:55:42,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyPolicy/ae3648a2636fe2f7065dcbeb2d18bd58/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-30 14:55:42,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:55:42,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ae3648a2636fe2f7065dcbeb2d18bd58: 2023-10-30 14:55:42,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1698677614358.ae3648a2636fe2f7065dcbeb2d18bd58. 2023-10-30 14:55:42,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ec271b0922387a1f6bc7f4f6943da47d, disabling compactions & flushes 2023-10-30 14:55:42,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:42,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:42,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. after waiting 0 ms 2023-10-30 14:55:42,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:42,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/ec271b0922387a1f6bc7f4f6943da47d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 14:55:42,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:42,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ec271b0922387a1f6bc7f4f6943da47d: 2023-10-30 14:55:42,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1698677721432.ec271b0922387a1f6bc7f4f6943da47d. 2023-10-30 14:55:42,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a6b42c30fdf80b11a56103e006bbd97c, disabling compactions & flushes 2023-10-30 14:55:42,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:42,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:42,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. after waiting 0 ms 2023-10-30 14:55:42,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:42,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionFromAdmin/a6b42c30fdf80b11a56103e006bbd97c/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 14:55:42,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:42,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a6b42c30fdf80b11a56103e006bbd97c: 2023-10-30 14:55:42,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1698677721432.a6b42c30fdf80b11a56103e006bbd97c. 2023-10-30 14:55:42,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 8461785ef16c68760c326406dffef392, disabling compactions & flushes 2023-10-30 14:55:42,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:55:42,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:55:42,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. after waiting 0 ms 2023-10-30 14:55:42,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:55:42,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8461785ef16c68760c326406dffef392/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-10-30 14:55:42,180 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:55:42,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 8461785ef16c68760c326406dffef392: 2023-10-30 14:55:42,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698677644182.8461785ef16c68760c326406dffef392. 2023-10-30 14:55:42,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing bb974e53dc6d462888c86a0e83d2293c, disabling compactions & flushes 2023-10-30 14:55:42,180 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:55:42,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:55:42,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. after waiting 0 ms 2023-10-30 14:55:42,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:55:42,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/ns/testMinorCompaction/bb974e53dc6d462888c86a0e83d2293c/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 14:55:42,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:55:42,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for bb974e53dc6d462888c86a0e83d2293c: 2023-10-30 14:55:42,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1698677692379.bb974e53dc6d462888c86a0e83d2293c. 2023-10-30 14:55:42,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 575c0b5fb7911565c72999b4af89996c, disabling compactions & flushes 2023-10-30 14:55:42,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:55:42,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:55:42,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. after waiting 0 ms 2023-10-30 14:55:42,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:55:42,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testMajorCompactionWithMonthlyPolicy/575c0b5fb7911565c72999b4af89996c/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-10-30 14:55:42,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:55:42,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 575c0b5fb7911565c72999b4af89996c: 2023-10-30 14:55:42,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1698677584332.575c0b5fb7911565c72999b4af89996c. 2023-10-30 14:55:42,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 48f76e58a4a35e9459816951bbe6c769, disabling compactions & flushes 2023-10-30 14:55:42,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. 2023-10-30 14:55:42,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. 2023-10-30 14:55:42,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. after waiting 0 ms 2023-10-30 14:55:42,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. 2023-10-30 14:55:42,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testScannerOnBulkLoadRefHFiles/48f76e58a4a35e9459816951bbe6c769/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-10-30 14:55:42,191 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. 2023-10-30 14:55:42,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 48f76e58a4a35e9459816951bbe6c769: 2023-10-30 14:55:42,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1698677609283.48f76e58a4a35e9459816951bbe6c769. 2023-10-30 14:55:42,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing bb4420255160505884d9c82dfe0aed2b, disabling compactions & flushes 2023-10-30 14:55:42,191 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:55:42,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:55:42,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. after waiting 0 ms 2023-10-30 14:55:42,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:55:42,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/bb4420255160505884d9c82dfe0aed2b/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-30 14:55:42,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:55:42,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for bb4420255160505884d9c82dfe0aed2b: 2023-10-30 14:55:42,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1698677667058.bb4420255160505884d9c82dfe0aed2b. 2023-10-30 14:55:42,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ae1fa8048a3a8e4b39683c8300846593, disabling compactions & flushes 2023-10-30 14:55:42,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:55:42,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:55:42,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. after waiting 0 ms 2023-10-30 14:55:42,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:55:42,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/default/testCompactionWithHFileLink/ae1fa8048a3a8e4b39683c8300846593/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-30 14:55:42,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:55:42,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ae1fa8048a3a8e4b39683c8300846593: 2023-10-30 14:55:42,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1698677667058.ae1fa8048a3a8e4b39683c8300846593. 2023-10-30 14:55:42,266 DEBUG [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-30 14:55:42,466 DEBUG [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-30 14:55:42,490 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/.tmp/rep_barrier/a01a255f88df4c9a9855ac4b657d3a3e 2023-10-30 14:55:42,501 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a01a255f88df4c9a9855ac4b657d3a3e 2023-10-30 14:55:42,667 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-30 14:55:42,667 DEBUG [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-10-30 14:55:42,667 DEBUG [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-30 14:55:42,867 DEBUG [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-30 14:55:42,908 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/.tmp/table/c242b5482ece4e1483e2d9fdd80a9e28 2023-10-30 14:55:42,913 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c242b5482ece4e1483e2d9fdd80a9e28 2023-10-30 14:55:42,914 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/.tmp/info/f43ac092921646eea1d0723152896a6b as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/info/f43ac092921646eea1d0723152896a6b 2023-10-30 14:55:42,918 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f43ac092921646eea1d0723152896a6b 2023-10-30 14:55:42,918 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/info/f43ac092921646eea1d0723152896a6b, entries=226, sequenceid=130, filesize=37.9 K 2023-10-30 14:55:42,919 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/.tmp/rep_barrier/a01a255f88df4c9a9855ac4b657d3a3e as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/rep_barrier/a01a255f88df4c9a9855ac4b657d3a3e 2023-10-30 14:55:42,922 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a01a255f88df4c9a9855ac4b657d3a3e 2023-10-30 14:55:42,923 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/rep_barrier/a01a255f88df4c9a9855ac4b657d3a3e, entries=1, sequenceid=130, filesize=5.0 K 2023-10-30 14:55:42,923 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/.tmp/table/c242b5482ece4e1483e2d9fdd80a9e28 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/table/c242b5482ece4e1483e2d9fdd80a9e28 2023-10-30 14:55:42,927 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c242b5482ece4e1483e2d9fdd80a9e28 2023-10-30 14:55:42,927 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/table/c242b5482ece4e1483e2d9fdd80a9e28, entries=27, sequenceid=130, filesize=6.6 K 2023-10-30 14:55:42,930 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1265ms, sequenceid=130, compaction requested=false 2023-10-30 14:55:42,935 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-10-30 14:55:42,935 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-30 14:55:42,935 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-30 14:55:42,935 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-30 14:55:42,935 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-30 14:55:43,067 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,36359,1698677568317; all regions closed. 2023-10-30 14:55:43,075 DEBUG [RS:0;jenkins-hbase20:36359] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/oldWALs 2023-10-30 14:55:43,075 INFO [RS:0;jenkins-hbase20:36359] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C36359%2C1698677568317.meta:.meta(num 1698677570664) 2023-10-30 14:55:43,081 DEBUG [RS:0;jenkins-hbase20:36359] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/oldWALs 2023-10-30 14:55:43,081 INFO [RS:0;jenkins-hbase20:36359] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C36359%2C1698677568317:(num 1698677570075) 2023-10-30 14:55:43,081 DEBUG [RS:0;jenkins-hbase20:36359] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:55:43,082 INFO [RS:0;jenkins-hbase20:36359] regionserver.LeaseManager(133): Closed leases 2023-10-30 14:55:43,082 INFO [RS:0;jenkins-hbase20:36359] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-30 14:55:43,082 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-30 14:55:43,083 INFO [RS:0;jenkins-hbase20:36359] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:36359 2023-10-30 14:55:43,091 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,36359,1698677568317 2023-10-30 14:55:43,091 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-30 14:55:43,091 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-30 14:55:43,092 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,36359,1698677568317] 2023-10-30 14:55:43,092 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,36359,1698677568317; numProcessing=1 2023-10-30 14:55:43,093 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,36359,1698677568317 already deleted, retry=false 2023-10-30 14:55:43,093 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase20.apache.org,36359,1698677568317 expired; onlineServers=0 2023-10-30 14:55:43,093 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,43911,1698677567334' ***** 2023-10-30 14:55:43,093 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-30 14:55:43,094 DEBUG [M:0;jenkins-hbase20:43911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bd1df56, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-30 14:55:43,094 INFO [M:0;jenkins-hbase20:43911] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,43911,1698677567334 2023-10-30 14:55:43,094 INFO [M:0;jenkins-hbase20:43911] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,43911,1698677567334; all regions closed. 2023-10-30 14:55:43,094 DEBUG [M:0;jenkins-hbase20:43911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 14:55:43,094 DEBUG [M:0;jenkins-hbase20:43911] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-30 14:55:43,094 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-30 14:55:43,094 DEBUG [M:0;jenkins-hbase20:43911] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-30 14:55:43,094 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1698677569805] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1698677569805,5,FailOnTimeoutGroup] 2023-10-30 14:55:43,094 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1698677569805] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1698677569805,5,FailOnTimeoutGroup] 2023-10-30 14:55:43,094 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-30 14:55:43,094 INFO [M:0;jenkins-hbase20:43911] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-30 14:55:43,094 INFO [M:0;jenkins-hbase20:43911] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-30 14:55:43,094 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 14:55:43,095 INFO [M:0;jenkins-hbase20:43911] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-10-30 14:55:43,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-30 14:55:43,095 DEBUG [M:0;jenkins-hbase20:43911] master.HMaster(1512): Stopping service threads 2023-10-30 14:55:43,095 INFO [M:0;jenkins-hbase20:43911] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-30 14:55:43,096 ERROR [M:0;jenkins-hbase20:43911] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-10-30 14:55:43,096 INFO [M:0;jenkins-hbase20:43911] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-30 14:55:43,096 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-30 14:55:43,097 DEBUG [M:0;jenkins-hbase20:43911] zookeeper.ZKUtil(398): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-30 14:55:43,097 WARN [M:0;jenkins-hbase20:43911] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-30 14:55:43,097 INFO [M:0;jenkins-hbase20:43911] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-30 14:55:43,097 INFO [M:0;jenkins-hbase20:43911] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-30 14:55:43,097 DEBUG [M:0;jenkins-hbase20:43911] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-30 14:55:43,097 INFO [M:0;jenkins-hbase20:43911] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 14:55:43,097 DEBUG [M:0;jenkins-hbase20:43911] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 14:55:43,097 DEBUG [M:0;jenkins-hbase20:43911] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-30 14:55:43,097 DEBUG [M:0;jenkins-hbase20:43911] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 14:55:43,097 INFO [M:0;jenkins-hbase20:43911] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.10 KB heapSize=598.92 KB 2023-10-30 14:55:43,107 INFO [M:0;jenkins-hbase20:43911] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.10 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a82f8349eddc4dba85668d9fd53754e3 2023-10-30 14:55:43,110 INFO [M:0;jenkins-hbase20:43911] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a82f8349eddc4dba85668d9fd53754e3 2023-10-30 14:55:43,111 DEBUG [M:0;jenkins-hbase20:43911] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a82f8349eddc4dba85668d9fd53754e3 as hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a82f8349eddc4dba85668d9fd53754e3 2023-10-30 14:55:43,115 INFO [M:0;jenkins-hbase20:43911] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a82f8349eddc4dba85668d9fd53754e3 2023-10-30 14:55:43,115 INFO [M:0;jenkins-hbase20:43911] regionserver.HStore(1080): Added hdfs://localhost:38259/user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a82f8349eddc4dba85668d9fd53754e3, entries=123, sequenceid=1006, filesize=33.3 K 2023-10-30 14:55:43,116 INFO [M:0;jenkins-hbase20:43911] regionserver.HRegion(2948): Finished flush of dataSize ~513.10 KB/525416, heapSize ~598.91 KB/613280, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=1006, compaction requested=false 2023-10-30 14:55:43,117 INFO [M:0;jenkins-hbase20:43911] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 14:55:43,117 DEBUG [M:0;jenkins-hbase20:43911] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-30 14:55:43,119 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/0a90f818-6756-e60f-248e-9f63a2f9f97d/MasterData/WALs/jenkins-hbase20.apache.org,43911,1698677567334/jenkins-hbase20.apache.org%2C43911%2C1698677567334.1698677569139 not finished, retry = 0 2023-10-30 14:55:43,193 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-30 14:55:43,193 INFO [RS:0;jenkins-hbase20:36359] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,36359,1698677568317; zookeeper connection closed. 2023-10-30 14:55:43,193 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10183557d440001, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-30 14:55:43,193 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@20afc5b7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@20afc5b7 2023-10-30 14:55:43,194 INFO [Listener at localhost/34621] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-10-30 14:55:43,220 INFO [M:0;jenkins-hbase20:43911] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-30 14:55:43,220 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-30 14:55:43,221 INFO [M:0;jenkins-hbase20:43911] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:43911 2023-10-30 14:55:43,223 DEBUG [M:0;jenkins-hbase20:43911] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,43911,1698677567334 already deleted, retry=false 2023-10-30 14:55:43,324 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-30 14:55:43,324 DEBUG [Listener at localhost/34621-EventThread] zookeeper.ZKWatcher(600): master:43911-0x10183557d440000, quorum=127.0.0.1:49804, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-30 14:55:43,324 INFO [M:0;jenkins-hbase20:43911] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,43911,1698677567334; zookeeper connection closed. 2023-10-30 14:55:43,326 WARN [Listener at localhost/34621] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-30 14:55:43,330 INFO [Listener at localhost/34621] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-30 14:55:43,394 WARN [BP-1606791183-148.251.75.209-1698677564337 heartbeating to localhost/127.0.0.1:38259] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1606791183-148.251.75.209-1698677564337 (Datanode Uuid 6d91fac6-672b-4e44-9534-6547ad81bdfc) service to localhost/127.0.0.1:38259 2023-10-30 14:55:43,399 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/cluster_978bf1f8-7fe4-59b0-fbf7-a402efa6c985/dfs/data/data1/current/BP-1606791183-148.251.75.209-1698677564337] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-30 14:55:43,400 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f91c4814-f241-cc17-156e-64efbc9c65d4/cluster_978bf1f8-7fe4-59b0-fbf7-a402efa6c985/dfs/data/data2/current/BP-1606791183-148.251.75.209-1698677564337] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-30 14:55:43,464 INFO [Listener at localhost/34621] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-30 14:55:43,495 INFO [Listener at localhost/34621] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-30 14:55:43,590 INFO [Listener at localhost/34621] hbase.HBaseTestingUtility(1293): Minicluster is down